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ABSTRACT 

The Educational Testing Service (ZTS) was contracted 
by the National Center for Education Statistics to investigate 
changes in tested achievement using cross-sectional comparisons 
between the 1972 National Longitudinal Study (NLS) seniors and the 
1980 High School and Beyond (HSB) senior cohort. The ETS is also 
responsible for estimating the extent and correlates of cognitive 
growth that takes piace between the sophomore and senior year in high 
school; this latter analysis involves testing the 1980 HSB sophomore 
cohort and following them m 1982 with the same test battery. To 
discharge these responsibilities, an extensive psychometric analysis, 
reported here, was undertaken. The analysis was designed to: (1) 
estimate possible effects of differing administrative procedures from 
one cohort to another on tested performance; (2) evaluate whether the 
tests were measuring the same things across cohorts or within 
different administrations within the same cohort; (3) estimate item 
statistics, reliabilities, and indices of precision of measurement 
for separate testa and determine whether these measures are invariant 
across sex and ethnic group; and (4) develop and apply latent trait 
theory procedures where appropriate. There is little empirical 
evidence for the notion that the tests or test parcels measure 
different things for different ethnic or sex groups. The biggest 
gams over the 2-year schooling period were in vocabulary and 
reading. White students showed greater gams that did either of the 
other ethnic groups. There was a consistent tendency for Hispanic 
women to show greater gams than Hispanic men, and for the test score 
variance to increase from the sophomore to senior year. Student test 
booklet samples, 25 data tables, and 22 figures are included. 
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EXECUTIVE SUMMARY 



The Educational Testing Service (ETS) was contracted by NCES to 
investigate changes in tested achievement using cross-sectional comparisons 
between the 1972 National Longitudinal Study (NLS) seniors and the 1980 High 
School and Beyond (HS&B) senior cohort. In addition NCES has contracted ETS 
to estimate the extent and correlates of cognitive growth that takes place 
between the sophomore and senior year in high school. This latter analysis 
involves testing the 1980 HS&B sophomore cohort and following them up in 1982 
with the same test battery. 

Test scores are the critical indicators of change and growth in the above 
cross-sectional and longitudinal analysis. Because of the importance of the 
test batteries as indicators of change, an extensive psychometric analysis was 
undertaken to: 

o Estimate possible effects of differing administrative procedures 
from one cohort to another on tested performance. 
Evaluate whether the tests were measuring the same things across 
cohorts or within different administrations within the same cohort. 
That is, is the underlying factor structure the same across 
administrations? Similar evaluations were done for sex a«H 
ethnic groups. 

o Estimate item statistics, reliabilities, and indices of precision of 
measurement for the separate tests and determine whether these 
measures are invariant across sex and ethnic groups. 
Develop and apply Item Response Theory procedures where 
appropriate to put nonidentical but corresponding tests given to 
differrent cohorts on the same scale. 
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As the first step in the psychometric analyses, approximately 2,000 field 
supervisor reports were examined for administration irregularities with the 
conclusion that no answer sheets should be rejected on the basis of the 
review. Editing procedures were carried out on the 1 12 and 1980 test 
batteries to insure that administrative and test format variations did not 
seriously affect subsequent cross-sectional comparisons. The results of the 
editing suggested that the picture number and mosaic comparisons tests should 
not be included in future cross-sectional comparisons. Test format changes 
make the 1972 to 1980 comparisons on the highly speeded mosaic comparisons 
test of questionable validity. The picture-number test was rejected for 
possible test administration problems. The editing procedures did not 
identify any problems with the remaining tests. 

Item analysis statistics were computed for all tests in all 
administrations. The purpose of the item analysis was to investigate whether; 
(1) the tests were at the appropriate difficulty level, (2) the 1980 sophomore 
cohort battery had sufficient "ceiling" so that gains can be a reasonable 
expectation, and (3) the tests and possibly subtests have sufficient 
reliability to support reasonably accurate estimation of mean changes and 
changes in individual rank ordering over time. 

The results of the item analysis suggest that the tests were slightly 
more difficult than would be suggested by measurement theory. However since 
the NLS and HS&B populations were characterized by considerable diversity in 
ability, one has to consider the tradeoff from having a test that may be on 
the easy side and, as a result, suffer from possible ceiling effects for some 
subpopulations. The item analysis results suggest a reasonable compromise was 
made. 
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With respect to reliability, there is little in the way of changes in 
reliability or standard errors of measurement when comparing NLS 1972 seniors 
with 1980 HS&B seniors. However in the longitudinal comparison there is a 
consistent gain in the reliabilities of the total test scores as one goes from 
the sophomore to the senior year. Similar gains in reliability were found for 
all the subtests with the exception of the biology subtest* It is suggested 
that future science score gains might be computed two ways — one with the 
biology items included and one with them left out* 

The reliabilities were lower for blacks and hispanics when compared with 
whites, whereas standard errors of measurement vere about the same, suggesting 
that the precision ot measurement was about the same for all racial groups* 
The difference in reliabilities were apparently a function of smaller standard 
deviations for minority groups* 

Of the total test scores, only the civics test was of sufficiently low 
reliability to question its use in any individual change score analysis* The 
subtests for the most part were not sufficiently reliable to justify their use 
as measures of change in individual rank ordering. 

Confirmatory factor analysis was carried out in an effort to determine 
what the tests are and are not measuring; and whether what is being measured 
is the same across cohorts and selected subpopulations within cohorts* The 
factor analysis was carried out on rationally derived subtest "parcels" whose 
homogeneity was verified in the above reliability analysis* 

The factor analysis results suggested that there is little if any change 
in factor structure either cross-sectionally (i.e., when comparing 1972 and 
1980 senior cohorts) or in the longitudinal comparison of sophomores with 
seniors. With the exception of the writing style, punctuation parcels, and the 
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physics parcels, the remaining subtest parcels seen to possess little or no 
unique reliable variance beyond that Which can be explained by a verbal and/ 
or aethematlcs factor. Black and hlspanlc factor structures were quite 
similar to white structures with the exception that performance on the science 
measures has a larger verbal component for hlspanlcs than for whites. A 
similar finding, although less pronounced, is present when coopering the black 
structure with thst of the whites. One somewhat surprising result is that 
there is no Increased differentiation between the verbal and mathematics 
fsctors when going from sophomore to senior status (as measured by the feet or 
intercorreletion) . However, there is sn Increased differentiation between 
individuals (as measured by Increased test score vsrisnce) as the trensltion 
from sophomore to senior takes place, it is possible that more achievement 
factors end additional factor differentiation would emerge if populations were 
defined by curriculum. Individual* in the academic curriculum would be more 
likely to take more specialised courses in their psrticulsr interest or skills 
areas. This should lead to more differentiation. In sum, there is little 
empirical evidence here for the notion that the tests or test parcels are 
measuring different things for different ethnic or sex groups c 

Item response theory (IRT) was used o score tests within populations 
(sophomore to senior cohort), and to score and equate tests across 
populstions. IRT methods were used to put mathematics, vocabulary, and 
reading scores on the same scale for 1972, 1980 and 1982 seniors. Similarly, 
IRT methods were used to score all the RS&B tests given to individuals as 
sophmores and repeated as seniors. The three parameter IRT model was used in 
preference to the one and two parameter models because of the possibility that 
guessing and/or speededness might be additional confounding sources of 
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variance. The IRT analysis allowed one to compare how 1980 and 1982 seniors 
would score if they took the 1972 vocabulary, reading, and mathematics tests. 

The results of the cross-sectional IRT equating suggest there is a 
continued decline in reading and mathematics ores from 1972 to 1980, and to 
1982 in both the total population and in sex and race groups. Although 
vocabulary scores declined from 1972 to 1980 for seniors, they tended to level 
off between the 1980 and 1982 seniors in the total groups. Although the 
vocabulary decline appears to be arrested in the total group, both blacks and 
hispanics continue to show some decline between 1980 and 1982, 

The results of the sophomore-senior longitudinal test score gains 
analysis using IRT scales suggested: 

• The biggest gains over the two-year schooling period were in vocabulary 
and reading. Gains in math and science were considerably smaller on 
average. One might wonder why the biggest gains occurred in an 
achievement area that would seem at first glance less curriculum 
relevant. However, reading and vocabulary are skills that are central 
to achievement in all curriculum areas. 

• Whites tended to show greater gains than did either cf the other ethnic 
groups. This differential gain was more pronounced when whites were 
compared with hispanics. 

• There was a consistent tendency for hispanic women to show greater gains 
than hispanic men. This may reflect curriculum differences as well as a 
differential drop-out rate. That is, lower scoring hispanic males may 
be more likely to stay in school than are their female counterparts. 

• There is a consistent tendency for the test score variance to increase 
as one goes from the sophomore to senior year. This increase is the 
normal expectation when an educational treatment is applied. 
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Psychometric Analysis of NLS and HS&B Cognitive Tests 

The cognitive tests used in the National Longitudinal Study of the 
High School Seniors Class of 1972 (NLS) and in High School and Beyond 
(HS&B) have a long and complex history, which is recorded, with one 
exception, only in an assortment of work statements, memoranda, progress 
reports, and unpublished project reports. The one exception is a preliminary 
analysis of the tests given in 1980 to the sophomores and seniors in HS&B 
(Heyns & Hilton, 1982), The purpose of this report is primarily to 
describe the psychometric analyses of the NLS and HS&B test batteries 
that were done as part of a study of Excellence in High School Education 
undertaken by Educational Testing Service (ETS> in the fall of 1983 
under the sponsorship of the National Center for Education Statistics 
(NCES). A secondary purpose is to summarize in one place a number of 
previously unpublished reports that are important background to the 
psychometric work performed as part of the High School Excellence Study. 

Brief Description of the Four Batteries and 
Their Interrelationships 

1972 Senior Tests 

In the spring of 1972, 18 randomly selected senior students in each 

of a sample of 1,044 randomly selected high schools were given a battery 
1 

of cognitive tests as part of the base year survey of the longitudinal 



*The adjective "cognitive- is used in reference to a broad category of 
tests that might include basic intellectual skills, achievement, developed 
ability, and scholastic aptitude. 
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study, which was to continue for an unspecified time. A total of 16,860 
students completed the tests. As of this writing, four follow-ups have 
been conducted and a fifth follow-up is in the planning stage. The 
battery consisted of six tests, which are listed in the left-hand column 
of Figure 1. These cests and a brief description of each follows 
(additional descriptive material is included in a later section on the 
history of the development of the tests): 

Vocabulary - Fifteen moderately difficult items consisting of one word 
followed by five possible synonyms. Test-taker selects one 
word or phrase whose meaning is closest to that of the stem. 
Time — 5 minutes. 

Picture-Number - Test of short-term associative memory, from the ETS 

Manual for Kit of Factor-referenced Cognitive Tests (Ekstrom et al. , 
1976) in which the test-taker first studies pairs of pictures 
and 2-digit numbers and then is shown the pictures only and is 
asked to select the number on the answer sheet that was paired 
with picture. Time — 3 minutes to study 15 items in Part 1, 
and 2 minutes to answer; and similarly for Part 2. 

Reading - Relatively unspeeded measure of reading comprehension in 
which 5 reading passages are given and test-taker answers a 
total of 20 multiple choice questions (each with 5 options) 
concerning what is stated or implied In each passage. Time— 15 
minutes. 

Letter Groups - Test, from the ETS Man ual for Kit of Factor-referenced 
Cognitive Tests , designed to measure inductive reasoning, 
consisting of five groups of letters among which four groups 
share a common characteristic and the fifth group is different. 
The test-taker indicates which group differs from the others. 
O Time— 15 minutes. j i 
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Figure 1 
NLS and HS&B Tests 



1972 

Stnion 

Vocabulary (15) - 



15 



Future-Number, Fart 1 (15) 
Picture-Number, Fart 2 (15) 



15 



Reeding (20) ^~ 



Letter Groups (25) 
Mathematics (25) ^- 



20 



12 w 



I960 



Vocabulary, Part 1 (15) 
Vocabulary, Part 2 (12) 

Picture-Number, Fart 1 (15) 
Raading (20) ^ 



1982 
Vocabulary (21) 



Raading (20) 



Mathematica, Part 1 (25) ^ 
Mathematics, Fart 2 (8) 



18° 
0 



Mathematics, Fart 1 (28; 
Mathematics, Fart 2 (10) 



Mosaic Comparisons 
Psrts 1 and 2 (89) 
Fart 3 (27) 



89 



Mosaic Comparisons 
Parts 1 and 2 (89) 



Visualisation in Threa Dimensions (16) 
"Questions About the Tests" 



Science (20) 
Writing (17) 
Civics (10) 



Sophomores 



(None) 



( ) - number of items. 



Vocabulary (21) 
Reading (20) 

Mathematics, Fart 1 (28) 
Mathematical Fart 2 (10) 

Science (20) 

Writing (17) 

Civics (10) 



(None) 



Indies tea number of items in common. 
°Six additional items are highly similar. 

Svelve items are common to the three senior clsss mathematics tests. 
*1980 S oph omore tests sre Identical to 1982 Ssnior tests. 
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Mathematics - Twenty-five items in which the test-taker indicates which 
of two quantities is greater, or equal, or that the data given 
are insufficient to make a decision. The items were selected to 
not require specific algebraic, geometric, or trigonometric 
skills. Time — 15 minutes. 
Mosaic Comparisons - This test, from the ETS Comparative Prediction 

Battery (French, 1964), was used as a highly speeded measure of 
perceptual speed and accuracy. One hundred and sixteen pairs 
of tile-like patterns require the test-'.aker to detect small 
differences in the design. Time—Iart 1 (56 items) 3 minutes; 
Part 2 (33 items), 3 minutes; Part 3 (27 items), 3 minutes. 
Total testing time - 69 minutes. 

The test battery was administered prior to the student questionnaire 
by a survey administrator in each school, usually a guidance counselor or 
an experienced teacher. The front page of the test booklet and the 
instructions for each test and sample items are shown in Appendix A. 
(Qualified researchers can borrow full copies of the tests by writing T. 
L. Hilton, Division of Measurement Research and Services, Educational 
Testing Service, Princeton, NJ 08541.) The students marked their answers 
in a separate mark-sensed answer sheet, not in the test booklet. 

1980 Senior Tests 

In the spring of 1980, as part of High School and Beyond, 36 randomly 
selected seniors and 36 randomly selected sophomores were surveyed in 
each of 1015 high schools. Both the seniors and the sophomores were 
given test batteries that roughly paralleled the 1972 test. As shown in 
Figure 1, the 1980 6enior tests were quite similar to the 1972 senior 
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t*. Five of the 6 tests given in 1972 were repeated; 151 of the 164 
items or 92% of the items in these 5 tests were identical. For reasons 
which will be explained shortly, the entire Letter Groups test was 
dropped, as well as parts of two other tests, to make room for a test of 
spatial relations (Visualization in Three Dimensions) and a self-report 
measure of the student's reactions to the testing situation ("Questions 
About the Tests"). Brief descriptions of these two instruments added to 
the 1980 senior test battery follow. 

Visualization in Three Dimensions - This test, which was used in 1960 in 
Project TALENT (Flanagan et al. , 1962), is a measure of "the 
ability to visualize how a figure would look after manipulation 
in three-dimensional space, by folding a flat figure to make a 
three-dimensional figure." Each of the 16 items in the test 
has a drawing of a flat piece of metal, in th? left-hand column 
and drawings of five objects on the right, onl*' one of which 
could be made by folding the flat piece of metal. The test-taker 
selects the one object that could have been made. Time — 9 
minutes. 

Questions About the Tests - This S-item self-report questionnaire 
was designed to tap factors that may have prevented the 
test-takers from performing as well as they might have under 
optimum testing conditions. Included are questions inquiring 
about the importance of the testing to the students, their 
concern about doing well, how much they enjoyed participating, 
and how they felt while taking the tests. Time — 5 minutes 
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The total 1980 senior test battery and the time allowed was as 
follows: 

Vocabulary 

Part 1 5 minutes 

Part 2 4 minutes 

Reading 15 minutes 

Mathematics 

Part 1 15 minutes 

Part 2 4 minutes 

Picture-Number 5 minutes 

Mosaic Comparisons 

Part 1 3 minutes 

Part 2 3 minutes 

Visualization in Three Dimensions 9 minutes 

Questions About the Tests 5 minutes 

Total time - 68 minutes 
The test battery was administered after the questionnaires by the 
Test Administrator or School Coordinator, who were school staff members 
with limited survey responsibilities, while the Team Leader and Team 
Coordinator, who were NORC personnel with broad survey responsibilities, 
scanned the student questionnaires for completion of "critical items." 

In 1982, as part of the first follow-up of the 1980 sophomore 
cohort, those cohort members who were still in the same schools were 
asked to take again the same tests they had taken as sophomores and 
under the same conditions. Sample members who had graduated early, 
or had transferred to another school, or had dropped out were located and 
given the tests in specially arranged small groups. The front page of 
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the test booklet, instructions, and sample items for those tests which 
were new to the 1980 and 1982 test batteries are shown in Appendix A. 

Certain additional details about the 1980 test administrations are 
described shortly* 

1980 Sophomore Tests 

For the sophomores the basic academic skill tests (Vocabulary, 
Reading, and Mathematics) were retained — with some changes at the item 
level and in the lengths of the tests — and three short conventional 
achievement tests were added. These were as follows: 

Science - Twenty items measuring knowledge of general science, 
biology, chemistry, physics, and the scientific method. Each 
multiple choice item has a stem and five options. Time — 10 
minutes 

Writing - Seventeen multiple choice items testing use of capitaliza- 
tion and punctuation, form, and style concerns. Each item has 
four options. Time — 10 minutes 

Civics Education - Ten multiple choice items covering graph reading 
(1), American history (2), American government (3) and miscellaneous 
current issues requiring inferential reasoning (4). Each item has 
four options. Time — 5 minutes 

Thus the total 1980 sophomore test battery and the time allowed was 
as follows: 



Vocabulary 



7 minutes 



Reading 



15 minutes 



Mathematics 



Part 1 



16 minutes 



Part 2 



5 minutes 
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Sclence 10 minutes 

Writing i0 minutes 

Civics Education 5 minutes 

Total time — 68 minutes 

1982 Senior Tests 

This battery was simply a reprinting of the 1980 sophomore tt * 
battery, with changes only on the cover. 

All of the original sophomores who were still in the same high schools 
two years later were in the retest sample, but the original sophomores who 
had graduated early, transferred to another school, or had dropped out were 
subsampled. Ninety-four percent of the in-school participate and 90 percent 
of the out-of-school participants (including transfer students) took the 
tests. Over 22,400 sophomore cohort members took the tests in both 1980 
and 1982. 

Common Items 

As a result of the modifications of the tests from 1972 to 1980 and the 
differences between the sophomore and senior test batteries in 1980 ond, thus, 
between the 1980 and the 1982 senior tests (since the 1980 sophomore tests are 
identical to the 1982 senior tests), there are only a small number of items that 
are common to the 1972, 1980, and 1982 senior tests. These common items 
are shown in Table 1. All told, 68* of the 1972 items are common to the 
1972 senior and 1980 senior tests (assuming that the six 1980 Math items 
with editorial or format changes can be regarded as identical), but only 
19* of the 1980 senior cohort items are common to the 1980 sophomore 
cohort, and 15* of the 1972 items are common to all three tests batteries. 
What might be regarded as a fourth battery, namely, the battery given to 
the 1982 seniors, was identical to that given to the 1980 sophomores. 
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Table 1 



Common Items in Senior Test Batteries 



Matching Matching 



1972 1980 1982 

Item Mo. Item No.* Item No. 

Vocabulary 

1 1 5 

2 2 New 

3 3 7** 

4 4 10 

5 5 11 

6 6 New 

7 7 13 

8 8 15 

9 9 New 

10 10 New 

11 11 New 

12 12 18 

13 13 19 

14 14 New 

15 15 21 



Picture-Number - Part 1 (i5 items) is identical in 1972 and 1980, 
The 1982 battery has no Picture-Number items. 



Reading 
1 
2 
3 
4 

5 

6 

7 

8 

9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 



X 
2 
3 
4 

5 

r> 

7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 




New (Defective item, 
not scored) 

New 

14 

15 

16 

17** 

10 

11 

12 

13 
New 
New 
New 
New 
New 
New 
New 



Letter Groups - No Letter Groups items were us jd in 1980 or 1985 . 



•Number in column is the number of the test item that is identical to 
the 1972 test item in that row. 
♦•Minor item differences judged to be trivial. 
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Table 1 (continued) 
Common Items in Senior Test Batteries 



1972 
Item No. 

Nathan atica, Part 1 

1 
2 
3 
4 
5 
6 
7 

e 

9 

10 

11 

12 
13 
14 
15 
16 
17 
16 
19 
20 
21 
22 
23 
24 
25 



Mathematics Part 2 



No tost 



Mosaic Comparisons 

Part 1-S6 itans 
Part 2-33 items 
Part 3-27 Itans 



Matching 

I960 
I tan No. 



Naw to '60 

2 

3 

4 

S 

6 Edit change only 
Naw to '60 
Naw to '60 
Naw to 9 60 

10 

IT Edit changa only 

12 

13 

14 Format changa 

15 Format changa 
16 

17 

13 Edit changa only 
Naw to '80 

20 
21 

22 Edit changa only 

Naw to '80 

24 

Naw to '80 



1980 Itama 



8 (Dafactiva it am, 
not acorad) 



Zdantical to 
Identical to 
No teat 



•72 
72 



Matching 

1982* 
Item No. 



Naw to '82 

2 

3 

4 

S 

6 Same aa '60 
Naw to '62 
Naw to '62 
Naw to '62 

10 

11 Sana aa '60 

12 
13 

14 Sana aa '60 

15 Sana as '80 

16 
17 
16 



Sana aa 

62 



'60 



'60 

Naw to 

20 
21 

22 Same as 
Naw to '62 
24 

Naw to '62 

26 Naw to '62 

27 Naw to '62 
26 Naw to '62 



1962 Itans 

1 Naw to 



2 
3 
4 

S 
6 
7 



Naw to 
Naw to 
Naw to 
Naw to 
Naw to 
Naw to 
6 Naw to 
9 Naw to 
10 Naw to 



No test 
No test 
No teat 



'62 
'62 
'62 
'62 
'62 
'62 
'62 
'62 
'62 
'62 



Notai Nona of the remaining tests was common to any of the batteries. The 
I960 sophomore battery was identical to the 1982 senior battery. 



•The 1982 Math test. Part 1, contained 26 items and took 16 minutes. 



9 

ERLC 



-11- 



Dlfferences in Administration and Format 

Although the purposes and general setting of the 1972, 1980, and 
1982 test administrations were comparable, there were certain differences 
that may have significance in interpreting any observed differences in 
score distributions across the years. Accordingly, each administration 
will be briefly described and certain dissimilarities will be pointed out, 

1972 Administration 

The test data collection was conducted by Survey Administrators, 
usually appointed by the school superintendent of the school district or 
the principal of the participating high school, as part of the data 
collection for the base-year survey. Because the survey was undertaken 
late in the spring of the school year— typically in the month of April— 
approximately 10% of the schools agreed to participate only if they did 
not have to conduct the test administration. Another 10% of the schools 
either refused to participate or could not do so because of early closing 
dates. Thus, the school participation rate was 80%, 

Eighteen seniors were randomly selected for participation by Educational 
Testing Service from rosters sent to Princeton by each participating school. 
Five additional students were randomly selected as replacements in the event 
any seniors in the primary sample refused to participate. Although no Incentive, 
financial or otherwise, was offered for participation, and participation was 
voluntary, a high percentage of the students agreed to participate. Useable 
student questionnaires were obtained from 88% of the students and 95% of these 
students participated in the testing, (NCES, 1983, p, 38) 

The eighteen students typically were assembled in a classroom and, 
in accordance with the 18-page Survey Administrator's Manual, were first 
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given the test battery and. then, following a ten-minute break, the student 
questionnaire. The Survey Administrator's Manual provided detailed 
directions for seating and supervision of the students and for arranging 
make-up sessions, 

1980 Administrations 

In 1980, 36 sophomores and 36 seniors were randomly selected for 
participation within each high school. Useable student questionnaires 
were obtained from 82% of the sample members and 88Z of these students 
participated in the testing. (NCES, 1983, p. 38). The students were 
assembled in classrooms or in a cafeteria or auditorium. In contrast to 
the NLS procedure, the tests were administered after the questionnaires, 
while NORC personnel checked the student questionnaires for completion of 
-critical items." In some unknown fraction of the schools, presumably 
small, the sophomores and seniors were given the tests at the same time 
despite differences in the timing and instructions for the tests. Some 
other differences between the ways in which test data were obtained in 
1972 and 1980 are discussed in the following sections. 

Other Administrative Differences 

*• Guessing instructions . In 1972 the students were not told 
how the tests would be scored, i.e., that there would be a penalty 
for guessing, whereas in 1980 the students were told that theJr "score 
on each section will be the number of correct answers minus a percentage 
of the number of incorrect answers. Therefore, it will not be to your 
advantage to guess unless you are able to eliminate one or more of 
the answer choices." The one exception was the test of Visualisation 
in Three Dimensions in which the students were told that their score 
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would be the "number of correct answers." (The purpose of this exception 
was to make the instructions for this test parallel to the procedures 
followed in Project TALENT (Flanagan et al., 1962) from which the test 
was reproduced.) In both 1972 and 1980 the tests were scored by formula 
(S-R-W/(n-l), where R is the number right, W the number wrong, and n is 
the number of choices in each item) with the exception of Visualization 
in Three Dimensions, which was scored number right. In a recent study, 
Angoff and Schrader (1984) demonstrated that formula scores are invariant 
with respect to directions. The wording of the instructions given the 
students in the Angof f-Schrader experiment differed somewhat from that 
used in the 1972 and 1980 administrations and also the sample characteristics 
differed (college applicants vs. high school seniors). Thus, their 
results may not be generalizable to the present case. If not, then the 
absence of formula instructions in 1972 may have favored that sample. 

2 - Answer sheets . In 1972 the student 6 marked their answers on an 
answer sheet separate from the test booklet. A copy of the sheet is 
shown on the following page. In 1980, however, the students marked their 
answers in the test booklet by blackening ovals adjacent to the options 
they selected. (Some examples are shown in the sample items in the 
Appendix A. ) 

A second difference was that the 1972 answer 6heet required the 
student to blacken a v- x , whereas NORC asked students to completely fill 
in an oval. On the answer uheet, the 1972 students were told to "Be sure 
each mark is dark and completely fills the answer box." 

Third, the separate 1972 answer sheet did not precisely map the 
format of the test booklet, i.e., the arrangement of item response grids 
into columns on the 1972 answer sheet did not match the columns in the 
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Fi b ure 2 



NATIONAL LONGITUDINAL STUDY OP THE HIGH SCHOOL CIA OF 1972 FORM USE 



EQE B E B B BBB 

EDEBB E EE BE 

E □ E B B BBB BB 

EDEBB EQBEE 









j BBEBE 


EEEEE 




; BBBBB 


EEEEE 







MCTtON 1 - VOCAIUlAtt 



I I 

lEBESE IBBBBB MDB0BE 7BBBBB IBBBBB HEBEEB UBEEEB uEEEEB 
IEEEBB 4BBBBB IBBBBB IBBBQB UBBBBB UBBBEE MEBEBB 



•86888 

.56688 68888.88888 
>88888 fl688e'»8868B 
.86BBB 6888B ; »68686 
88888 68688;*6688B 
.58868 fl888Bu88588 
.68868 88868-68888 
>B6B66 688861.88886 



MCTION 1 « nCTUM-NUMMt 



88886 
66888 
88888 
66668 
86668 
86668 
66668 
66666 



Nrtl 



•88688 
»6B686 
•66888 
•66886 
•66866 
•66866 
•66666 



8886B 
6588B 
66668 
□8888 
66686 
66566 
68868 



•68886 
•66686 
•88686 
•66688 
•66886 
•66888 
•86668 
•86688 



66668 
88868 
68866 
68866 
86668 
68686 
66668: 
66686 



MCnONS-MAMNO 


ticrtoN 4 - umi otovn 


IKTIONS- 


MATH! MA TICS i 


iB B B B B MB B B B B 


iBBBBBhBBBBE) 


lBBBB 


MBBBB 1 


IBBBBB uBBBBB 


IB B B B B iSB B B B B 


2BBBB 


UBBBB 


IBBBBB HE BBBB 


SB S B S B KB B E E B 


SBBBB 


UBBBB 


«B B B B B i'B BBBB 


4BBBBB WEE EBB 


4BBBB 


UBBBB 


IBBBBB UBBBBB 


sBBBBB UBBBBB 


SBBBB 


UBBBB 


IBBBBB uBBBBB 


IBBBBB UBBBBB 


•BBBB 


UBBBB ; 


7B B B B B »E B B 3 B 


'dBEEB MEBEBB 


'BBBB 


••BBBB 


•BBBBB 


•BBBBB &BBBBB 


•BBBB 


HB B B B 


•EBEBB 


IBBBBB 8B BBBB 


•BBBB 


»E B BB 


MEBBBB 


uBBBBB SBBBBB 


MBBBB 


MBBBB j 


uBBBBB 


uBBBBB MB BBBB 


nBBBB 


MBBBB 


UBBBBB 


UBBBBB BBBBB B 


UQBBB 


&BBBS 


UBBBBB 


11B B B B B 


uBBEB 
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HBBB 


uBBB 


iQBB 


11BBB 


uBBB 


iQBB 


uBBB 


mBBB 


30 BB 


UBBB 


stBBB 


<□ BB 


uBBB 


MBBB 


sQBB 


aEBE 


uBBB 


•EBB 


uBBB 


uBBB 


7EBB 


22BBB 


uBBB 


•EBB 


aBBB 


mBBB 


M3BQ 


mBBB 


uBBB 


NQBB 


HBBB 


41BBB 


11QBQ 


HBBB 


41BBB 


UQBQ 


27BBB 


42BBB 


UQBH 


MB BE 


uBBB 


"EBB 


»BBB 


44B BB 
1 



motion i~ 

45BBB 

uBBB 

47BBB 

ME BE 

*BBB 

»BBB 

11E SB 

UBBB 

UBBB 

MBBB 

kEBB 

mBBB 

wBBBB 
UBBBB 
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MBBBB 74B B B B 



•BBBB 
11BBBB 
UBBBB 
UBBBB 
MBBBB 
12?) B B B 
mBEBB 
UBBBB 
MBBBB 
MBBBB 
mBEBB 
nBBBB 
72B B B B 
nBBBB 
~~T~ 



nBBBB 
nBBBB 
77QBBB 
TtBBBB 
nBBBB 
■BBBB 
nBBBB 
nBBBB 
uBBBB 
MBBBB 
MBBBB 
MBBBB 
"BBBB 
MBBBB 



MBBBB U3BBBEB 
nhs imBBBBB 
MBBBBBitsBBBBB 
hBBBBBimBBBBB 
WBBBBBU7BBEBB 
MB BBtSBiMB B B B B 
MBBBBBiMBBBBB ! 
MBBB BBiuB BBBB 
MBBBBBlilBBBBB 
i?B B B B B MB BBBB 
MBBBBBlilBBBBB 
MBBBBBiuSBBBB 
BBBBiUBBBBB 
MiBBBBBiuBBBBB 
imBBBBB 
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test booklet. For example, the Mosaic Comparisons items in the test 
booklet had 12 items in each column whereas the answer sheet had 14 items 
in each column. 

It is difficult to know exactly what the net effect of these 
format differences was, but it seems likely that, on balance, the 1980 
format saved the respondent a substantial amount of time, particularly 
on the Mosaic Comparisons Test, which is a speed test. A team at the 
Air Force Humsn Resources Laboratory conducted an experiment in which 
the effect of several similar format differences were examined (Earles 
et al., 1983). They concluded that the net effect was highly significant 
for speeded tests— amounting to nearly one-half a standard deviation 
for the most speeded test. The design of their experiment did not permit 
the estimation of the relative magnitude of the different sources of 
effects. 

3» Administration date . Because the contract for the 1972 data 
collection was awarded later in the academic year than the award for 
the 1980 data collection, the 1972 test administrations in the schools 
were conducted approximately one month later in the school year than 
was the 1980 administration. Since the tests in question we.e measures 
of aptitude or developed ability in contrast to content specific tests 
and both administrations were conducted late in the senior year— generally 
regarded as a time of little learning— we supp >se that this discrepancy 
made at most a slight difference in performance. For another reason, 
however, many— perhaps 25%— of the 1972 students may have been at a 
disadvantage in that they were given the tests during the last week of 
school, a week of many distractions. We would guess that this counter- 
balanced any advantage the 1972 sample in general may have had from being 
tested one-month later than the 1980 students. 

9 
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*• Order of the tests within the battery . As shown below, the 
order in which the tests were given in 1972 differed from the order in 
1980. What effect this change in order may have had is unknown, although 
it seems likely that fatigue increases and motivation decreases towards 
the end of the testing. If so, then the order might have favored the 1980 
students since the tests which were not common to the two administrations 
(Letter Groups in 1972 and Visualizations in Three Dimensions in 1980) 
were given fourth in 1972 and last in 1980). 

1972 1980 
Section 1. Vocabulary Section 1. Vocabulary (Parts 1 & 2) 

Section 2. Picture-Number (Parts 1 & 2) Section 2. Reading 
Section 3. Reading Section 3. Mathematics (Parts 1 & 2) 

Section 4. Letter Groups Section 4. Picture-Number 

Section 5. Mathematics Section 5. Mosaic Comparisons (Parts 1 & 2) 

Section 6. Mosaic Comparisons (Parts 1-3) Section 6. Visuallzrtion in Three 

Dimensions 

5. Order of questionnaire and test administration . As noted 
earlier, in 1972 the tests were given first and then the student 
questionnaires, whereas the order was reversed in 1980. Again, we know 

of no directly relevant methodological studies investigating the possible 
effect of such a reversal in order but it f eems likely that completing a 
long and complicated questionnaire (33 pages for the sophomores and 35 
I ages for the seniors) just prior to the test administration would have 
had a deleterious effect on the performance of the 1980 test-takers 
because of fatigue. 

6. Seating and other instructions . In 1972 the Survey Administrators 
were given detailed instructions about seating the students so as to make 
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copying and collaboration difficult (for example, "seat students in 
alternate rows") whereas no such instructions were given in 1980. In 
addition, only in 1972 were instructions given about prohibitions 
in the testing room (no books, slide rules, etc.) and how routine 
absences, mistimings, emergencies, and other problems should be handled. 

7. Supervision . Only in 1972 were the staff instructed to "walk 
around the room" during the administration of the test. Presumably, in 
1980 the school personnel or NORC representatives present were busy 
checking the student questionnaires during the test administration. 

Any reduction i ^rvision in 1980 might have encouraged collaborating 
but, on the other hand, any added supervision in 1972 might have resulted 
in a more controlled testing situation conducive to test performance. 

8. Timing of Picture-Number Test . In 1972 the survey administrators 
were instructed to tell the students that they would have three minutes 

to study Part 1, and at the end of three minutes to tell them to turn to 
the test page for Part 1. Two minutes later the students were told to 
stop. In 1980 the survey administrators were not instructed to tell the 
students when three minutes were up, although the test booklet informed 
them that they would have only three minutes to study part one and then 
two minutes for the test questions. What effect this difference had is 
uncertain. If it resulted in the 1980 students 1 taking more than 3 
minutes to study Part 1, then the effect may have been nontrival. 

9. Group size . In 1972, the typical testing session included 
18 students, whereas in 1980 36 to 72 students were tested together 
depending on whether the sophomore and senior subjects were tested in 
separate rooms or together. This may ha^e resulted in more distractions 
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in 1980, but it also iiay have made it easier for students to collaborate 
if any were so inclined. With one exception we would expect the distrac- 
tions of the larger group to be the more important factor. The except *i-n 
was the Picture-Number Test, which may wvJi nave had inflated s i*i 
1980 because of the difficulty of supervising tne laigei t'.rouis. hetter^ 
tested this hypothesis by computing the rejiressior coefficient 
Picture-Number Test formula scores on test-group size w.ile co^' r ' \ii 
for the students' self-reported grade average, curriculum, sex> race, and 
socioeconomic status (1984). In both 1972 and 1980, the coefficients 
were positive and significantly greater than zero. Thus, the effect d 
the larger groups In 1980 may have been appreciable although Fetters 
estimated that at most it would account for less than 50 percent of the 
higher mean in 1980. (1984, p. 7) 

Summary 

On balance what can we say about the effect of differences between 
the 1972 and i980 test batteries in their format and administration? 
Table 2 summarizes our best guess as to which administration would 
be favored by the difference cited above. Weighting a slight advantage 
as one and a moderate advantage as two, the "score 1 * would seem to be 3 
to 6 in favor of the 1980 administration. In view of our uncertain 
knowledge of the true magnitude of the effects discussed, the cautious 
position would be that neither administration had an advantage. A less 
cautious conclusion is that the 1980 subjects probably had some small 
advantage and that the advantage may have been greater on some tests than 
others, e.g., tests requiring close supervision and timing. 
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Table 2 

Administration Favored by Differences in Administration 

1972 1980 
testing instructions * 
Answer sheets 

a. In booklet ** 

b. Marking space 

c. Mapping of tests and answers ** 
Administration date - - 
Ore of the tests * 
Order of questionnaire and test administration ** 

Seating and other instructions * 
Super'/ision 

Group size - - 



- - No difference 
^ * ■ Possible slight advantage C 

** = Possible moderate advantage 1 
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History of Development of Tests 

Having briefly described the NLS and HS&B tests and their administra- 
tion, we will in this section recount the history of their development 
from 1971 to the present. We do this partly to document a line of 
developmental research that has important implications for educational 
research in this country, and partly to assist the reader in understanding 
the purposes and proper uses of the test scores. 

The 1972 Tests 

That the data collection for the National Longitudinal Study 
of the High School Class of 1972 should include one or more measures of 
student ability was originally recommended in a design for the study 
prepared in 1971 by Research Triangle Institute under contract with 
the National Center for Education Statistics (Horvitz et al. , 1972). 
The design report described the objectives of the study as follows: 
The survey is expected to provide needed insights into the 
significant alternative patterns of development experienced by 
students beyond high school, detailed information on the 
factors affecting these patterns and methods for relating the 
occupational and postschool experiences of individuals to their 
school experience. 
Later in the report the first of ten main objectives listed was as 
follows: 

1. To identify factors associated with alternative postsecondary 

school career choices and students' persistence in these choices. 
Of six broad categories of factors which determine postsecondary 
school career paths, the first was "the student's ability, especially 
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in the cognitive area." (p. 19) To measure student's ability, the 
authors proposed to use the student questionnaire with one exception ; 
this was that the student's Intelligence should be measured through 
"an objective IQ test"; the Quick Word Test, a 100-ltem multiple 
choice vocabulary test (Borgatta & Corsinl, 1967). 

A field test of the Instruments designed by the RTI staff Included 
the Quick Word Test. The results, however, caused the RTI staff to 
recommend that the test be eliminated. "The student's own classification 
of his ability... together with his overall grade point average and rank 
ir class should provide a sufficient measure or Index of ability." 
(p. 193) Nevertheless, the Request for Proposals for the base year 
survey of NLS-72 specified that the Quick Word Test would be used. 
Moreover, in responding to the RFP, Educational Testing Service not 
only endorsed the Idea of including an objective measure of vocabulary, 
but also recommended that the measurement of student ability be broadened 
to Include "other measures of verbal aptitude and other forms of basic 
skills which have been shown to be Important predictors of academic or 
vocational training and on-the-job performance" (Hilton, 1971, p. 4-8). 
A second reason for considering measures to supplement the QWT was that 
"legitimate Issues can be raised regarding Its appropriateness for 
minority group members from culturally disadvantaged backgrounds." 
(p. 4-8). 

On January 27, 1972, NCES awarded the contract for the base year 
survey to ETS and endorsed the concept of expanding the coverage of the 
cognitive testing. It Is Important to note, however, that the primary 



ERIC 



-22- 

purpose of the expanded battery of tests continued to be to enhance 
the prediction of career development choices and outcomes. 

A team of 16 ETS professional staff members immediately undertook 
the design, clearance, pretest, review, revision, and production of 
the new test battery — a series of tasks completed in an eight-week 
period. (Hilton & Rhett, 1973) 

The final composition of the battery represented a balancing 
of somewhat opposing considerations. The primary objective was to 
obtain a more comprehensive description of students whose backgrounds, 
ethnicity, and socioeconomic status were quite diverse. At the same 
time, the need for comprehensive measures had to be balanced with the 
requirement of minimal testing time. Lengthy tests are a nuisance to 
schools that must schedule time to administer them and to students 
who must endure them without significant fatigue or loss of interest. 
For this reason, the battery was held to 69 minutes of testing time 
plus 36 minutes of administrative time for a total of 105 minutes. 

The tests were constructed to measure five distinct factors in a 
reasorably short period. They were selected on the basis of their 
efficacy in other ETS programs or projects, two of which were the 
Comparative Guidance and Placement Program (CGP), a guidance service 
for two-year colleges, and Project Access (a project for minority 
youth). 

Many of these tests existed even before the development of CGP and 
Project Access. Variations of some of the tests had been assembled by 
ETS in the Manual for the Kit of Factor-referenced Cognitive Tests and 
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made available to researchers throughout the country for experimental 
study. Thus, the tests used In NLS represented Instruments already 
established In psychometric research. 

A brief description of each test, abstracted from Hilton & Rhett, 
1973, and a summary of their psychometric properties follow. (A complete 
analysis of each test, based on data from the base-year survey, can be 
obtained from T. L. Hilton, ETS.) 

Vocabulary . A brief test using synonym format consisting of 
Items drawn from the longer Project Access Vocabulary Test. The 
items were selected to avoid academic or collegiate bias and to be 
of an appropriate level of difficulty for the NLS twelfth grade 
population. The 15 Items selected were those that constituted the 
then current CGP Vocabulary Test. 

Reading . Based on short passages (100-200 words) with several 
related questions concerning a variety of reading skills (analysis, 
Interpretation) but focusing on straightforward comprehension* The 
Reading Test drew upon Items from the CGP Reading Test and Items of 
particular relevance to minority *roup students taken from the 
Project Access Reading Test. 

Mathematics. The Items are quantitative comparisons In which 
the student Indicates which of two quantities Is greater, asserts 
their equality or the lack of sufficient data to determine which 
quantity Is greater. This type of Item Is relatively quickly answered 
and provides measurement of basic competence In mathematics at the 
same time minimising the amount of time required for actual computation. 
The test Is a shortened version of the CGP and Project Access Instruments 
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but omits those items that tap algebraic » geometric, or trigonometric 
skills. 

Letter Groups . This test of inductive reasoning requires the 
student to draw general concepts from sets of data or to form and 
try out hypotheses in a nonverbal context. The items consist of 
five groups of letters among which four groups share a common 
characteristic and the fifth group is different. The student 
indicates which group differs from the others. The test was used in 
exactly the same form in which it appeared in both the Project 
Access and CGP test batteries. 

Letter Groups, as a test of inductive reasoning, measures one of 
the four aptitudes (verbal, quantitative, reasoning, and spatial/ 
perceptual), which have considerable precedent in representing the 
varieties of cognitive skills. Tests of inductive reasoning have, 
in particular, been shown to be useful in research involving minority 
ethnic groups (Lesser, Fifer, & Clark, 1965; Stodolsky & Ljsser, 
1967; Flaugher, 1971). This test, in combination with the Mathematics 
Test that was included in the battery, provided a measure of the 
reasoning capacity of students. It also may have a verbal component: 
in a study of persistence in higher education, a confirmatory factor 
analysis showed it to have a loading on "performance aptitude 0 which 
in turn had a correlation of .77 with "verbal aptitude." (Hilton, 1982 , p. 9) 

Mosaic Comparisons . Measures perceptual speed and accuracy 
through items that required that small differences be detected 
between pairs of otherwise identical mosaics or tile-like patterns. 
A deliberately speeded test, it hap Lnree separately timed sections 
consisting of increasingly more complex mosaic patterns. Mosaic 
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Comparisons, a test in the CGP battery, represented another of the 
fundamental measurer used in many studies of aptitudes among minority 
groups. Tests like this which represent the spatial/ perceptual 
domain were selected for the 1972 battery — to allow minority 
students an opportunity to perform better than on other cognitive 
instruments. 

Picture-Number , This test of associative memory consists of 
a series of drawings of familiar objects, each paired with a 
number. The student, after studying the picture-number pairs, 
is asked to recall the number associated with each object. This 
test appeared in both the CGP and Project Access batteries. 

The inclusion of the Picture-Number Test represented acknowledg- 
mep'c of a line of research that suggested that minority populations 
have relatively higher mean scores in associative memory than in 
other types of ability (Semler & Iscoe, 1963; Rohwer, et al. , 1968; 
Jensen, 1968). 

Results from item and test analysis conducted in 1973 indicated that 
the 1972 test battery had quite satisfactory test characteristics. 
Comparison of the performance of White and Black students showed the 
White means to be uniformly higher by about one standard deviation except 
on Picture-Number on which the discrepancy was .7 standard deviations. 
These results and a number of studies supporting the predictive validity 
of these measures are described in Hilton and Rhett, 1973. 

The sequential order of the tests was chosen because it interspersed 
the three more conventional and the three more novel tests, an arrangement 
that provides interest and motivation for the examinees. Vocabulary was 
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chosen for the first position because of the inherent simplicity of this 
test's format and directions. At the outset, it was believed that the 
Vocabulary Test should build the confidence of the students in their 
capability to perform well. Because it is quite speeded, Mosaic Comparisons 
was placed last to prevent any anxiety that might be engendered by this 
speededness from persisting in later test sections. 

The 1980 Tests 

In the spring of 1978, ETS was given the contract to "revise" the 
1972 test battery so as to make the battery suitable for administration 
to two new cohorts of high school students, namely, the cohorts that 
became known as the 1980 HS&B Seniors and the 1980 HS&B Sophomores. The 
expectation of NCES was that some of the items in the 1972 test battery 
and possibly some of the tests would need to be replaced. The Work 
Statement transmitted to ETS stressed that it was "of the utmost 
importance that scores be obtainable from the revised instrument(s) that 
are statistically comparable to scores on the 1972 battery." 

In accordance with this charge, ETS, after weighing the pros and 
cons of a range of alternative solutions to the increasingly complex 
requirements of the cognitive tests, submitted a test plan to NCES 
(Donlon et al., 1978). This plan recommended that the Letter Groups, 
Picture-Number, and Mosaic Comparisons tests be dropped—primarily 
because a survey of users of the 1972 public release tape and of the 
research literature indicated that the tests had been little used— and 
that two tests be added to the batteries for Grade 10 and Grade 12 
(Science, and Career and Occupational Development) and in addition 
that a spatial relations test (Surface Development) be added to the 
Grade 10 battery and Abstract Reasoning to the Grade 12 battery. 
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Theae recommendations were accepted by NCES and the revised batteries 

were field tested by NORC, with ETS conducting the test analyses (Hilton 

et al., 1980)* When, however, the results were submitted to the National 

1 

Planning Committee for "High School and Beyond" , the design of the 
batteries was challenged. As described in some detail elsewhere (Heyns & 
Hilton, 1982), the Committee recommended to NCES that: 

the draft batteries be altered substantially to allow 
for the measurement of school effects and cognitive 
change in a longitudinal framework. The concerns of 
the Committee were twofold: First, conventional 
measures of basic cognitive skills are not designed 
to assess patterns of change over time, and there was 
strong feeling that the preliminary batteries would 
not be sufficiently sensitive to cognitive growth o 
allow analysts to detect differential effects among 
student 8. Second, the Committee recommended including 
items that would be valid measures of the skills or 
material a student might encounter in specific high 
school classes. 



Accordingly, after considerable discussion and consultation, 
the batteries were revised to, in brief, make the 1980 senior tests 
primarily a vehicle for measuring cross-sectional change from 1972 to 
1930 and the 1980 sophomore tests a baseline for the measurement of 
longitudinal change from 1980 to 1982. The final form of the tests is 
described in the firct section of this report. This form is the result 
of a complex sequence of decisions and represents a compromise between 
several competing mo. vations: to preserve comparability with the 
1972 battery but to introduce new measures more sensitive to school 
achievement; to maximize validity but to minimize testing time; to 



The members of the National Planning Committee were Robert F. Boruch, 
Bruce K. Eckland, Barbara Heyns, David S. Mundel, Robert C. Nichols, 
Ellis B. Page (Chair), Sally B. Pancrasio, and David E. Wiley* Edith M. 
Huddleston NCES, was the original project Officer for "High School and 
Beyond • " 
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achieve a conaon scale for the sophomore and senior tests but to 
target measurement at ench lewl. 

Whether each of the changes made was justified remains to be seen. 
The results of the Item and test analysis are described In the balance 
of this report, and the research analyses that make use of the tests 
will be described In subsequent project reports. 
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Prellmlnary Analysis of Data 

Examination of Weld Administrators Reports 

As a first step In the psychometric analysis of the test batteries, 

the ETS staff obtained from NORC copies of the reports by the NORC field 

staff who supervised the administration of student questionnaires and 

1 

the test batteries in each participating high school. Approximately 
2,000 field supervisors • reports covering the 1980 sophomore and senior 
administrations, the 1982 senior administrations, and various special 
administrations conducted for transfer students and dropouts were 
received from NORC. The ETS staff examined these one-by-one to identify 
those that cited any problems that might have affected the test scores. 
A total of 97 reports Included remarks suggesting there may have been 
events and conditions that might have reduced the validity of the test 
results. See Table 3. 

Practically none of the reports Indicated unequivocally that the 
answer sheets for a particular high school should be rejected. Eighteen 
of the supervisors reported incidences such as bomb scares (2), typhoon 
warnings (1), and shootings — of a teacher and three students on the 
morning of the data collection (1). A number of schools had fire drills 
during the data collection (typically they did not say whether it was 
during the test administration). Twenty-seven schools reported that 
the data collection was conducted in a cafeteria or an auditorium or 

1 

We are Indebted to Calvin Jones, NORC, for his able assistance in 
making these data available. 
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Table 3 

Summary of Unusual Circumstances Reported^ 



Confusion, chaos, bovb Kin, 
fira iUra f burglar alarn, 
shootings, ^nd tornado alart 



I960 i9 8 2 
Sophoseras 

and g£ni2£» In School Out of School ft>tal 



16 



Hoist, distractions, and 
interruptions 



10 



18 



I*cX of cooparation, atudants 
unruly, and hostility 



Sophovoras and saniors 
togathar 



Drug usaga in room 



10 
1 



10 



Problama judgad to ba 
inc on saquant ial 



Total 



22 
59 



16 

29 



10 



40 

97 



X Tha 

racaivad 



i3«d*f^*iiSSr riMd h "* «PProxim.t.ly 2.000 r.port. 
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a library where students were constantly moving in and out or were 
noisy or that the band was playing In the next room or outside, or that 
the PA system was constantly blaring, or that some "kids were making 
a ruckus in the back of the room.*' Ten supervisors volunteered the 
information that the seniors and the sophomores were surveyed in the 
same room at the same time. 

The results of this examination of field supervisors' reports were 
carefully considered by the project staff in consultation with other 
senior staff experienced in the effect of testing conditions on student 
performance. Two factors precluded certain corrective steps that 
might be taken. The first was that the ETS staff could not link the 
supervisors' reports to data on the public release data tape without 
making elaborate arrangements to protect the privacy of the schools. 
The second was the absence of any kind of objective rules by which 
to reject the data from a particular school. For example, how dis- 
tracting is a bomb scare in comparison to a band rehearsal next door. 
In view of these factors and the knowledge that editing of the data 
by other means would be considered, it was decided not to pursue the 
rejection of data on the basis of the supervisors' reports. 

Editing of the Test Data 

Prior use of the H£6B data by ETS staff in various studies has 
indicated that in general the public release file is relatively free 
of data processing errors and that the students' questionnaire responses 
and test responses by-and-large seem to have validity (see, for example, 
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Hilton, Schrader, & Beaton, 1983). The test scores appear to correlate 
with other test scores about as one vould expect of valid measures of 
student ability. Fo~ two reasons, however, it was deemed possible that 
the test data might — for a small fraction of the total cases — be defective. 
The first reason was based on the field supervisors' reports. As discussed 
above these reports indicated that, in some small subset of the participating 
high schools, testing conditions and procedures may have departed sufficient 1 v 
from the usual conditions and procedures to raise doubt about the 
appropriateness of using the data from these schools in a definitive 
study of test score changes from 1972 to 1980 and from 1980 to 1982. 

The second reason was based on a preliminary analysis of the test 
score changes from 1972 to 1980 by Beaton and Hilton (unpublished). 
These results indicated that the mean scores for the seniors from 
1972 to 1980 decreased somewhat in Reading and Vocabulary but increased 
dramatically for Picture-Number and Mosaic Comparisons. 

Several possible explanations can be offered for the large gains, 
including the possibility that some intervening influence (e.g., television, 
video games) has contributed to the development of new skills. Before 
such an interpretation is considered, however, an alternative explanation 
for the large score gain needed to be considered: this concerned the 
nature of the test administration and the unique attributes of the tests 
that showed large gains. As described earlier in this report, the 
Picture-Number test, designed to measure "hort-term memory, requires that 
the test-taker study pairs of pictures and numbers, and not turn back to 
them after turning the page to the section where only pictures are given. 
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Making sure that the test-takers do not turn the page back requires close 
supervision. Lapses in the supervision could result in inflated scores. 

The Mosaic Comparisons test also requires conscientious supervision 
in that it is a highly speeded test. If time limits are not strictly 
observed, inflated scores will result from this test also. 

Examining the test data for defective scores would be highly 
desirable in any case because of their important role in the study* Such 
an examination was done by Beaton, Hilton, and Schrader in 1980 when data 
from Project T/1ENT and the 1972 NLS cohort were used to examine the SAT 
score decline from 1960 to 1972 (Hilton & Schrader, 1980). 

The objective of the editing was to maximize the rejection of 
defective scores and minimize the rejection of nondefective scores. 
The problem is that one cannot assume that the scores on all the tests 
given within a particular school are defective simply because the scores 
on a particular test are seriously inconsistent. The Mathematics test, 
for example, may have been administered with care, and the Mosaic 
Comparisons test may have been carelessly timed. If, however, the 
results of other editing checks point to a particular set of data as 
defective, then we would accept the hypothesis. Thus, we pursued a 
conservative multiple criterion approach to the editing. In order to 
make the 1972 senior test data comparable to the 1980 senior data, it was 
decided to edit the 1972 data using similar procedures to those used for 
the 1980 data. 

At the school level, the problem was to identify schools with 
mean test scores having unusually large deviations from predictions 
bas J on other test scores. We also anticipated that examination of 
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the students' responses to Questions About the Tests might also raise 
questions about the validity of the responses for a particular school. 
School-by-school analysis of the questions relating to distractions 
might identify schools in which standard testing conditions were not 
maintained. 

At the individual level* the problem was to identify students 
whose test performance in general or whose performance on a particular 
test was seriously discrepant from what would be predicted on the basis 
of other student data. For example, students whose performance may 
have deteriorated towards the end of the test battery (through fatigue, 
or some disturbing condition or influence) could be identified by pre- 
dicting expected performance on the basis of performance on the earlier 
tests in the battery. 

In the following paragraphs, the results of a fairly large number 
of editing studies will be briefly summarised. 

1- First -half mean versus second-half mean . If the administration 
of a particular test was mistimed, then the mean score on the items in 
the last half of the test should deviate from what would be predicted 
on the basis of performance on the first-half of the test. Accordingly, 
for each test common to both the 1972 and the 1980 batteries, the mean 
scores of each school on the second-half of each test were regressed 
on the mean scores on the first-half of the test. The results, shown 
in Table 4, indicate that for most of the tests the first-half and 
the second-half were highly correlated and that the results for 1972 
were generally similar to the results for 1980. The three exceptions 
were the higher means scores in 1980 on the second-halves of the 
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Picture-Number Test and Parts 1 and 2 of the Mosaic Comparisons Test. 
However, the more important observation for editing purposes was that 
there were very few school means that one would regard as outliers. Figures 
3 and 4, for Vocabulary and Mosaic Comparisons, Part 2, are typical. 

2. First-half mean versus second-half attempts . As the second 
possible basis for editing, the regression of mean scores on the first- 
half of each test on the mean number of items attempted in the second- 
half of each test was examined. As shown in Table 5, the results 
indicated that the 1980 sample attempted more items, especially on the 
Picture-Number and the Mosaic Comparisons Tests but, again, examination 
of the scatter-plots showed relatively few outliers. 

3. Mean SAT scores versus second-half means . To investigate 
whether scores on an independently administered test would provide a 
basis for detecting outliers, mean scores were computed for those 
students within each school who took the SAT and then — for those schools 
with 10 or more SAT takers — regressions similar to the preceding regres- 
sions were computed. 1 The correlations between SAT Total and the 1972 
and 1980 second-half means ranged from .21 for Picture-Number to .86 for 
Mathematics, but examination of the residuals from prediction revealed 
no more than one would expect by chance. Repeating the analysis for 
SAT-Verbal scores did not appreciably change the results. 

A. Distraction scores . For the 1980 sample only, it was possible 
to construct a scale from those items in the Questions About the Tests 
that seemed to reflect the extent to which each test-taker may hav« 
been distracted during the test administration. However, this scale 

*SAT scores were retrieved for the 1980 seniors as part of a study 
conducted at ETS for the U. S. Army Recruiting Command (Hilton et al, 
1983). 
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Table 4 



titan Scored and Correlation Coefficients (r) Between First- and 
Second-Halves of Test Itcns for 1972 and 
1980 Seniors 







1972 






1980 






X 


r 






r 


Test 


1st half 


2nd half 




1st half 


2nd half 




Vocabulary 


4.1 


1.9 


.82 


3.7 


1.8 


.81 


Reading 


5.9 


3.4 


.83 


5.3 


3.1 


.87 


Math, Coomon 


3.8 


2.3 


.85 


3.6 


2.0 


.87 


Picture-Murtber 


4.3 


4.2 


.74 


5.0 


5.8 


.91 


Mosaic Comparisons 1 


15.0 


6.7 


.25 


15.2 


11.2 


.36 


Mosaic Comparisons 2 


11.9 


4.0 


.31 


11.7 


6.3 


.53 
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Table 5 

Mean Scores end Correlation Coefficients (r) Between Number of Attempts 
in First-Half of Item and Nuaber of Attempts in 
Second Half 







1972 






1980 






X 




r 


X 




r 


Test 


1st half 


Ho. of 
attempts 




1st half 


No. of 
attempts 




Vocabulary 


4.1 


6.8 


.23 


3.7 


7.3 


.04 


Reading 


5.9 


9.2 


.37 


5.3 


9.6 


.36 


Math, Canon 


3.8 


5.7 


.29 


3.6 


5.9 


.29 


Picture-Number 


4.3 


5.1 


.62 


5.0 


7.1 


.76 


Mosaic Comparisons 1 


15.0 


7.5 


.12 


15.2 


12.7 


.24 


Mosaic Comparisons 2 


11.9 


4- 7 


.07 


11.7 


7.7 


.29 



Figure 3 



Bivariate Distribution of School Means on First-half and Second-half 
of Vocabulary Test for 1980 Seniors 
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Figure 4 

Bivariate Distribution of School Means on First-half and Second-half 
of Mosaic Comparisons Test, Part 2, for 1980 Seniors 
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score was correlated only .13 with the total score on the Mosaic 
Comparisons Test — the test which was presumed to be most susceptible 
to distractions. This low correlation was judged to be insufficient 
as a basis for editing. Furthermore, examination of the mean test 
scores for schools in the top tenth percentile with respect to mean 
Distraction scores revealed no particular pattern of results. 

1980 Sophomore and 1982 Senior data . In view of the results 
obtained from the examination of the 1972 and the 1980 senior data, 
we concluded that similar examination of the 1980 sophomore and 1982 
senior test results was not necessary and, in addition, that examination 
of individual data would not be cost effective. 

Summary . With two exceptions, the various analyses conducted 
revealed no clear evidence of irregularities. The exceptions are 
the relatively high mean scores and mean number of attempts on the 
Picture-Number and Mosaic Comparisons Tests. The high scores on the 
highly speeded Mosaic Comparisons Test could be attributable to the 
format change noted in the section on differences in administration, 
namely, the change from a separate answer sheet to answering within 
the test booklet next to the stem of the item. In the absence of other 
evidence, we will assume that this is the case. 

The explanation of the relatively high scores on the Picture- 
Number Test is less clear. Of the several possibilities which have 
been mentioned, the likelihood that the 1980 administration was not as 
closely supervised as the 1972 administration and the fact that sub- 
8 t ant i ally larger numbers of students were involved in 1980 seem like 
the most relevant factors. In any case, in view of the differences, it 
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is recommended that the Mosaic Comparisons Test and the Picture-Number 
Test not be ised for cross-sectional comparisons between the 1972 and 
1980 cohorts. 
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Item Analysis of the NLS and HS&B Tests 
The traditional part of the psychometric analysis is divided into two 
sections. The first section is a discussion of the item analysis summary 
statistics by sex and ethnic group within cohort. The second section deals 
with the test reliabilities and standard errors of measurement by sex and 
ethnic groups within cohort. The item statistics and reliabilities are based 
on the weighted observations. The discussion of the item analysis results is 
necessarily a summary since any in-depth discussion of a battery of tests at 
the item level would add little reliable information beyond that provided by 
the psychometric analysis at the subtest and total test level. However, for 
readers who wish to examine how individual items performed for different sex 
and race groups, the complete tables for the NLS battery are presented in 
Appendices B1-B13. Appendices C1-C12 present the item statistics for HS&B 
high school senior test battery, and Appendices D1-D18 and E1-E18 present 
similar statistics for the 1980 sophomores and 1982 seniors cohort 
respectively. 

This item analysis section will review item analysis results within 
cohort groups with respect to whether: (1) the tests are at the appropriate 
difficulty level, (2) the tests have sufficient ceilings so that "gains" can 
be a reasonable expectation, (3) whether the item biserials are positive 
within each group, and (4) the tests and possibly subtests have sufficient 
reliability to support reasonably accurate estimation of mean changes and 
changes in individual rank ordering over time. 

The 1972 NLS Battery Item Statistics 

The appendices show the proportion in each cohort group who responded 
correctly (Pf). They also show item biserials and deltas. The item oiserials 
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give the correlation between the item response (right vs. wrong) and the total 
test score. The size of the biserial correlation indicates the extent to which 
a given item measures the same "things" as the remainder of the test. The 
item deltas are defined as A ■ 4 t~ l (1-P^) +13 where *" J is the inverse 
normal transformation that transforms a probability value into a normal 
deviate with unit variance. Thus the distribution of item deltas will have a 
mean delta of 13 and standard deviation of 4. Summary statistics for each 
test are presented at the bottom of each table. 

Inspection of appendices B1-B13 indicates that the 1972 NLS tests have 
mean scores (with the exception of letter groups) that vary from a low of 35% 
correct to almost 60% correct for the total population. In some subgroups the 
means are as low as 20% correct. Although gain scores are not a concern at 
this point, for the NLS seniors these results suggest there is sufficient 
ceiling on all the NLS test scores. We are arbitrarily defining a sufficient 
ceiling as a perfect score minus the group mean divided by the group standard 
deviation. This "ceiling index" should be equal to 1.5 or greater. Normal 
curve theory would, of course, suggest that optimal measurement would take 
place if there were "room" for two stiidard deviations above the mean. 
Psychometric theory, however, suggests that the test might best be somewhat 
easier to minimize the frequency of guessing. 

The item biserials for the NLS battery are all relatively high. There is 
a consistent tendency for blacks and hispanics to have lower biserials for 
both vocabulary and mathematics. Although biserials are intended to be 
relatively insenstive to "split" (difficulty levels), if one plots biserials 
by difficutly levels, a "banana" shape is usually observed. That is, easy and 
hard items tend to have somewhat lower biserials. Since the vocabulary and 
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mathematics items tend to be harder on average for blacks and hlspanlcs, we 
would also expect somewhat lower biserlals. 

The reliabilities of the tests and subtests will be discussed separately 
in the following sections* 
1980 Senior HS&B Battery Item Statistics 

Similar to the NLS battery, mean scores for the total 1980 senior sample 
ranged from approximately 35% correct (visualisation in three dimensions) to 
47% for the mathematics test. There is little or no celling effect for the 
1980 senior HS&B battery as defined by the "celling index." All measures had 
a ceiling index of 2.0 or greater. Item biserlals were positive for all 
subgroups and in quite acceptable ranges; that is, most were above .40. Once 
again, blacks and hlspanlcs had slightly lower biserlals for the mathematics 
and vocabulary vests. As before, this differential probably reflects the 
differences in difficulty and/or restriction in range of the black and 
hispanic total scores. 

One very Interesting finding here is the difference in the number of 
items attempted between the 1972 seniors and the 1980 seniors; that is, the 
1980 seniors consistently attempted more items than did the 1972 seniors. 
This is shown on the bottom of the item analysis tables in the appendices. 
The proportion of the total items that were not reached (the average number of 
items not reached divided by the total number of items in the test) was double 
on the average for 1972 seniors compared to 1980 seniors. 

This finding is probably not the result of dlff rences in administration 
conditions or M test wiseness," but simply the result of a mechanical change 
from answer sheets separate from the test booklet to answer sheets within the 
booklet. Because test score changes between 1972 and 1980 are confounded with 
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this test format change, any comparison of means between 1972 and 1980 should 
attempt to correct for this change in the number of items attempted. Item 
response theory (IRT) methods are an appropriate procedure for correcting for 
this problem. This technique, and its relevance to this problem, are 
discussed in the section on IRT. 

Item Statistics for 1 the 1980 Sophomore and 1982 Senior Cohort 

Appendices D1-D18 and E1-E18 present the item statistics for the 1980 
sophomores and for the same group as seniors in 1982. 

Since one of the primary purposes of this test battery was to measure 
changes in achievement over the last two years of high school, it is crucial 
that the measures be relatively free of ceiling effects. Inspection of the 
sophomore item statistics indicate, with the exception of the writing test, 
that the remaining tests all had ceiling indices of 2. or greater. The 
sophomore writing test had a ceiling index of 1.74. A summary of the ceiling 
indices (C.I.'s) are shown below: 



Test Sophomore (80) Senior (82) 

CI. C.I. 

Vocabulary 2.36 1.86 

Reading 2.83 2.41 

Math 2.66 2.28 

Science 2.43 2.19 

Writing 1.74 1.42 

Civics 2.04 1.64 
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A comparison of sophomore and senior C.I.'s suggests that ceiling effects 
do not appear to be a constraining factor on the measurement of gain within 
the total sample. When considering the potential for gain in terms of C.I.'s, 
the largest proportional gains were in reading (15 percent) and vocabulary 
(21 percent). These percentages are based on the difference between the 
sophomore and senior C.I.'s divided by the sophomore C.I. 

A comparison of the sophomore and senior biseria^s show an increase in 
the mean biserial when going from sophomore to senior status on all measures. 
This finding is consistent with the general increase in test reliability that 
occurs when one goes from sophomore to senior. This is discussed in detail in 
the test reliability section that follows. 

One anomaly is the finding of two negative item biserials in the 
mathematics test for blacks and hispanics in the sophomore administration. 
One of these items (i?28 in part 1, Table D8) changes to a positive biserial 
for senior blacks and hispanics, but the other item (//l in part 2 t Table D8) 
remains negative (Table D8). Inspection o* the items suggests nothing in the 
content that would lead one to expect that performance on these items should 
have essentially no relationship with total score for blacks or hispanics. 
These two items are anomalous in another way. They are the only two (of 38) 
for which Pf is higher for blacks than for whites. This type of anomaly will 
have less effect on black and hispanic scores when IRT scaling is used. The 
next section on reliability examines both total test score reliability and 
reliability of item parcels where the parcels are based on common item content 
and/or operations. 
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ReXiability of NLS and HSB Tests 

Table 6 presents the reliabilities and standard errors of measurement for 
the 1972 NLS and HSB tests by selected subpopulations. The reliabilities were 
estimated by coefficient alpha (Lord & Novick, 1968). Coefficient alpha is an 
estimate of internal consistency among item responses and thus reflects the 
homogeneity of item content as well as precision of measurement. If a test is 
complex with respect to the things that it is measuring, coefficient alpha 
will probably be an underestimate of the precision of measurement 
characterizing that test. Precision of measurement, as defined here, can be 
thought of as an estimate or the stability of scores within a group of 
individuals when the test instrument is repeated within a minimal time period. 
Ideally, the retesting would be based on an equivalent (parallel) form so that 
memory would not inflate the estimates. Since a test-retest design using 
equivalent forms was not used, such estimates, although more desirable, were 
not available. Fortunately, factor analytic results of the tests (to be 
described in detail later), suggest that, for the most part, each test is 
characterized by a single dominant underlying factor. The presence of a 
single dominant factor suggests that coefficient alpha is a reasonable 
estimate of the precision of measurement attained by the NLS and HSB 
measures. 

Reliabilities are population dependent in the sense that they reflect the 
homogeneity or variability of the trait within that population. Also, if a 
test is too hard (or too easy), there will be little variability in scores and 
thus the likelihood of a smaller reliability coefficient. The latter case 
reflects a fault in the measurement instrument, whereas the former (a 
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le88 likely possibility) is not necessarily the fault of the instrument. 
Since it is not easy to separate these two sources of influence on the 
reliability, the standard error of measurement! (SEM) is also shown for each 
Instance that a reliability coefficient is computed. The standard error of 
measurement provides an index of precision (small is better) that is 
relatively invariant with respect to population differences in variability on 
the assessed trait. Unlike the reliability coefficient, which is a 
standardised index, the SEM is measured in the original test score units and 
can be interpreted in the fashion of any standard error. That is, confidence 
bands can be formed about the observed score and probability statements can be 
made about such bands containing an individual's true score. 

Inspection of the total column of Table 6 suggests that, considering the 
lengths of the tests, the reliabilities are respectable, with the possible 
exception of the civics test. It is also encouraging to note that for the 
total population the reliabilities increase and the SEM 1 s become smaller when 
comparing the 1980 sophomores with the 1982 seniors. 

One curious result is that the reliability of the HSB 1980 senior 
mathematics test is .85, whereas the reliability of the shorter MLS 1972 test 
is .86. This finding would appear to be consistent with the fact that the 
1980 seniors on average attempted more items, but got fewer correct. The 
lower-than-expected reliability for the 1980 seniors could reflect an 
increased tendency to guess, and/or the fact that the longer test is less 
homogeneous • 

1 SEM ■ o x / 1 - r xx where r^ is the reliability of the test and a x is the 
standard deviation of the test. 
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Table 6 



RELIABILITY OF TOTAL TEST SCORES 
»* FORMULA SCORING) 



TOTAL 



MALE 



FEMALE 



WHITE 



BLACK 



HISPANIC WH MALE WH FEMALE BL MALE BL FEMALE 



H MALE 



H FEMALE 





ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


NLS 1972: 


















































VOCABULARY 


.78 


1.96 


.78 


1.96 


.78 


1.95 


.76 


1.95 


.63 


1.95 


.62 


2.01 


.76 


1.96 


.76 


1.94 


.63 


1.93 


.63 


1.96 


.66 


1.97 


.59 


2.03 


READING 


.79 


2.32 


.79 


2.32 


.79 


2.31 


.77 


2.31 


.73 


2.32 


.73 


2.37 


.77 


2.32 


.76 


2.30 


.76 


2.31 


.70 


2.32 


.75 


2.37 


.72 


2.35 


MATH 


.86 


2.74 


.87 


2.68 


.85 


2.78 


.85 


2.70 


.77 


2.86 


.80 


2.90 


.86 


2.64 


.84 


2.76 


.79 


2.85 


.75 


2.87 


.81 


2.89 


.78 


2.90 


HS8 1980 SENIORS: 


















































VOCABULARY 


.82 


2.75 


.83 


2.71 


.82 


2.76 


.82 


2.74 


.71 


2.76 


.73 


2.81 


.83 


2.70 


.81 


2.75 


.74 


2.76 


.69 


2.75 


.74 


2.80 


.73 


2.81 


READING 


• 79 


2.36 


.80 


2.36 


.78 


2.35 


.78 


2.35 


.73 


2.35 


.73 


2.40 


.79 


2.36 


.77 


2.34 


• 75 


2.37 


.71 


2.34 


.74 


2.40 


.71 


2.39 


HATH 


.85 


3.16 


.86 


3.11 


.83 


3.20 


.85 


3.13 


.77 


3.28 


.82 


3.28 


.86 


3.07 


.83 


3.17 


.81 


3.27 


.73 


3.28 


.84 


3.25 


.78 


3.30 



I 
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HSB 1980 SOPHOMORES: 



VOCABULARY 


.80 


2 


36 


.80 


2.33 


• 81 


2. 


37 


.79 


2.31 


.72 


2.46 


.73 


2. 


47 


.78 


2 


27 


.79 


2. 


33 


.73 


2 


.44 


.70 


2. 


46 


.72 


2.45 


.74 


2.48 


READING 


• 77 


2 


.28 


.77 


2.29 


.76 


2. 


27 


.76 


2.28 


.66 


2.23 


.64 


2. 


30 


.76 


2. 


28 


.76 


2. 


27 


.68 


2 


.24 


.64 


2. 


23 


.66 


2.31 


.63 


2.28 


MATH 


• 87 


3 


52 


• 88 


3.51 


.85 


3. 


53 


.87 


: .51 


.76 


3.51 


.79 


3. 


57 


.88 


3. 


48 


.85 


3. 


52 


.78 


3 


.50 


.74 


3. 


51 


.80 


3.58 


.76 


3.55 


SCIENCE 


.74 


2 


36 


• 76 


2.32 


.71 


2. 


40 


.69 


e.33 


.64 


2.40 


.68 


2. 


44 


.72 


2. 


28 


.66 


2. 


37 


.68 


2 


38 


.58 


2. 


41 


.71 


2.41 


.63 


2.46 


WRITING 


.80 


2 


30 


• 79 


2.35 


• 78 


2. 


25 


.79 


2.26 


.71 


2.40 


.73 


2. 


43 


.79 


2. 


33 


.75 


2. 


18 


.68 


2 


39 


.71 


2. 


40 


.71 


2.43 


.73 


2.42 


CIVICS 


• 52 


1 


85 


.54 


1.86 


.49 


1. 


84 


.51 


1.83 


.40 


1.89 


.45 


1. 


90 


.54 


1. 


84 


.47 


1. 


82 


.39 


1 


89 


.40 


1. 


89 


.46 


1.90 


.45 


1.88 



HSB 1982 SENIORS: 



VOCABULARY 


• 84 


2. 


26 


.84 


2.24 


• 85 


2. 


27 


.82 


2. 


19 


.79 


2 


.43 


.80 


2 


.42 


.82 


2. 


17 


.83 


2. 


20 


.80 


2. 


40 


.77 


2.45 


.80 


2.40 


. 2S 


2 


.44 


READING 


.80 


2. 


25 


.81 


2.25 


.80 


2. 


24 


.80 


2. 


24 


.70 


2 


.23 


.72 


2 


.29 


.80 


2. 


23 


.79 


2. 


23 


.71 


2. 


25 


.69 


2.22 


.72 


2.30 


.72 


2 


.27 


MATH 


.90 


3. 


44 


.91 


3.42 


.89 


3. 


45 


.90 


3. 


40 


.81 


3 


.48 


.84 


3 


.52 


.91 


3. 


37 


.88 


3. 


42 


.82 


3. 


48 


.80 


3.48 


.85 


3.53 


.82 


3 


50 


SCIENCE 


.76 


2. 


31 


.78 


2.26 


.74 


2. 


35 


.73 


2. 


27 


.67 


2 


.38 


.72 


2 


40 


.75 


2. 


Z\ 


.70 


2. 


32 


.73 


2. 


34 


.59 


2.40 


.74 


2.37 


.69 


2 


42 


WRITING 


.83 


2. 


17 


.82 


2.25 


.81 


2. 


09 


.81 


2. 


10 


.76 


2 


.35 


.80 


2 


34 


.82 


2. 


20 


.78 


2. 


00 


.74 


2. 


37 


.76 


2.33 


.78 


2.37 


.80 


2 


30 


CIVICS 


.60 


1. 


77 


.62 


1.78 


.58 


1. 


76 


.59 


1. 


73 


.53 


1 


87 


.55 


1 


87 


.61 


1. 


74 


.56 


1. 


72 


.55 


1. 


86 


.50 


1.87 


.54 


1.88 


.55 


1. 


85 



G3 
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Although the reliabilities are consistently lower for blacks and 
hispanics when compared with whites, the SEM's are only trivially larger (for 
blacks and hispanics), suggesting that much of the reliability difference may 
be due to population differences in variability. That is, there is a lower 
population variability for minority groups than for whites. 

In sum, it would seem safe to conclude that the tests are all 
sufficiently reliable to assess mean changes and, with the possible exception 
of the civics test, can be used to assess change in the rank ordering of 
individual scores. The relative equality of the SEM's across subpopulations 
suggests that the tests have similar precisions for whites, blacks, and 
hispanics. 

Reliabilities of the Subtests 

Test development experts at ETS were asked to look at item content and 
difficulty to form subtests based on groupings of items showing common content 
or processes. One purpose of the exercise was to form reliable "marker 9 * 
variables for potential factors that could be subsequently verified 
empirically with confirmatory factor analyses. In addition, these parcels 
generated scores with continuous scales that, in turn, were more likely to be 
normally distributed than, say, individual items. If the empirical results of 
the confirmatory factor analysis support the rational clustering of items in 
specific achievement areas such as science and writing, there is reason to 
believe that findings of differential gains by subject matter area would be a 
a distinct possibility. The NLS 1972 and the parallel senior cohort in 1980 
"shared" reading items and a common core of vocabulary and mathematics items. 
The reading test was partitioned into five separate subtests based on five 
separate reading passages. The mathematics test and vocabulary test were each 
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split into odd-even halves in order to provide two "pure" indicators of a 
mathematics and vocabulary factor. The HSB sophomore-senior cohort had a much 
"richer" test battery, and the test development specialists were able to 
classify the items across a number of content dimensions. The tests were 
partitioned into the item parcels in the following way: 

Number of Items in Each Subtest For NLS 1972 and HS&B 1980 Senior Cohort 



Subtest 



1972 



1980 



VOCABULARY ODD 
VOCABULARY EVEN 



8 
7 
5 
4 
4 
4 
3 

13 
12 



14 
13 
5 
4 
4 
4 
3 
16 
16 



READING PASSAGE 1 

READING PASSAGE 2 

READING PASSAGE 3 

READING PASSAGE 4 

READING PASSAGE 5 
MATHEMATICS ODD 



MATHEMATICS EVEN 



Number of Items in Subtests for HSB Sophomore Cohort 



VOCABULARY ODD 
VOCABULARY EVEN 
READING PASSAGE 1 
READING PASSAGE 2 
READING PASSAGE 3 
READING PASSAGE 4 
READING PASSAGE 5 
MATHEMATICS - ALGEBRA 
MATHEMATICS - ARITHMETIC 
MATHEMATICS - GEOMETRY 
SCIENCE - BIOLOGY 
SCIENCE - CHEMISTRY 
SCIENCE - PHYSICS 
SCIENCE - SES 
SCIENCE - METHODOLOGY 
WRITING - PUNCTUATION 
WRITING - STYLE 
CIVICS ODD 
CIVICS EVEN 



11 

10 
4 
4 
4 
4 
3 

12 

18 
8 
6 
3 
3 
4 
4 
6 

11 
5 
5 



pi r< 
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Tablee 7*10 present estimates of the reliabilities and SEM's for subtests 
by cohort population. Each table deals with a separate cohort population and 
presents reliabilities and SEM's by ethnic and sex groups within a cohort. 
Column means and standard deviations are presented at the bottom of each table 
column. These sutaary statistics allow for gross comparisons of reliabilities 
and SEM's by ethnic and sex subpopulatlons (columns). As with the total test 
scores the, reliabilities, of course, vary by subtest length and, to a lesser 
extent, by subpopulatlon. However, a comparison of the SEM's for a given 
subtest by subpopulatlon suggests that the subtests, like the total tests, are 
relatively invariant with respect to precision of measurement across 
populations within the same cohort. 

Direct cross-sectional comparisons of reliability changes for 
subpopulatlons from 1972 to 1980 (Tables 7 and 8) are not appropriate (with 
the exception of the reading subtest), since the lengths cf the tests are 
different. However, classical test theory suggests that the reliability of 
the math test should have increased from 1972 to 1980, since the 1980 test was 
lengthened by seven items. Part of the problem may result from the fact that 
the additional items tended to depart from the general arithmetic mold that 
characterised the original set administered in 1972. A contributing 
difficulty is the fact that the 1980 seniors tended to attempt more items than 
did the 1972 seniors and, as a result, were possibly more prone to guessing. 
At first glance it appears that, for most of the reading passages, the 
reliabilities decrease from 1972 to 1980 for blacks and hispanlcs, but these 
apparent changes in reliabilities are not always consistent with parallel 
changes in SEM's. 
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Table 7 



NLS 1972 
RELIABILITY OF SUB SCOPE 3 
C RIGHTS-ONLY SCORING) 



VOCABULARY 
000 ITEMS 
EVEN ITEMS 

REAOINB: 
PASSAGE 1 
PASS'S? 2 
PASSAGE 3 

MATHS 

ODD ITEMS 
EVEN ITEMS 

MEAN 
S.D. 



TOTAL MALE FEMALE WUTE BLACK HISPANIC W MALE NH FEMALE BL MALE BL FEMALE H MALE H FEMALE 



ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


•66 


1.13 


•M 


1.13 


.67 


1.12 


.63 


1.12 


.51 


1.16 


.55 


1.19 


.63 


1.13 


.64 


1.11 


.50 


1.15 


.50 


1.16 


• 62 


1.15 


•46 


1.22 


.63 


1.15 


.o3 


1.15 


.62 


1.14 


.62 


1.16 


.43 


1.10 


• 41 


1.13 


.62 


1.16 


.61 


1.15 


.46 


1.00 


.4v 


1.11 


•43 


1.12 


• 37 


1.14 


•S3 


•04 


• 55 


•05 


.50 


.02 


.49 


.01 


.54 


.94 


• 53 


.95 


.51 


•03 


.47 


.79 


.60 


.94 


.46 


• 95 


•60 


• 93 


•46 


.96 




•05 


• 51 


•05 


.53 


.05 


.40 


.05 


.45 


.06 


.52 


.05 


.47 


•04 


.49 


.05 


.46 


.05 


.46 


•06 


•50 


• 03 


•46 


•06 




• 05 


•49 


• 05 


.46 


.04 


.43 


.04 


.44 


.07 


.44 


.07 


.44 


•04 


• 41 


.04 


.40 


.06 


• 42 


• 07 


• 43 


•07 


•46 


•06 


•4t 


•86 


•40 


.06 


.44 


.06 


.40 


.07 


.30 


75 


.20 


.79 


.37 


•07 


• 42 


• 07 


.40 


.75 


• 36 


• 76 


• 40 


• 70 


• 11 


• 79 


•54 


• 71 


• 57 


• 70 


.51 


.72 


.52 


.72 


.39 


.65 


.39 


.70 


.55 


.71 


• 49 


• 73 


.46 


.63 


• 33 


• 66 


• 42 


• 70 


• 35 


• 69 


• 77 


1.49 


• 70 


1*47 


.75 


1.52 


• 75 


1.47 


.63 


J. 59 


.67 


1.60 


.76 


1.44 


• 73 


1.50 


.66 


1.59 


•60 


1*59 


•69 


1.59 


• 65 


1.60 


• 75 


1.45 


• 76 


1.41 


.74 


1.49 


.73 


1.44 


.64 


1.51 


.67 


1.52 


.74 


1.40 


.72 


1.40 


.67 


1.49 


•59 


1*52 


•60 


1.52 


•64 


1.53 


•59 


1.04 


• 60 


1.03 


.50 


1.04 


.56 


1.03 


.49 


1.05 


.49 


1.07 


.57 


1.02 


.55 


1.03 


.52 


1.04 


•46 


1.05 


• 54 


1.05 


•44 


1*07 


• 11 


• 27 


• 12 


• 26 


.11 


.20 


.12 


.26 


.09 


.31 


.12 


.30 


.12 


.25 


.12 


.20 


.09 


.31 


•09 


• 31 


• 11 


• 30 


• 15 


• 31 



I 
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Table 8 



HSB 1980 SENIORS 
RELIABILITY OF SUBSCORES 
(RIGHTS-ONLY SCORING! 



TOTAL MALE FEMALE WHITE BUCK HISPANIC UH MALE NH FEMALE BL MALE BL FEMALE H MALE H FEMALE 

Al 

VOCABULARY: 

OOD ITEMS ^.m* *wr *.-tt . j ^ .^T i.dj . * w x.^j .00 .5Y i e o£ .21c i.oj .s^ i.oj .:>v 1 ,o<* 1 

EVEN ITEMS .71 1.57 . 72 1.56 . 70 1.57 .71 1.57 .56 1.54 .57 1.58 .72 1.56 .70 1.58 .60 1.55 .55 1.53 .58 1.58 .57 1.58 

READING: 1 
PASSAGE 1 
PASSAGE 2 
PASSAGE 3 
PASSAGE 4 
PASSAGE 5 

MATH: 

000 ITEMS 
EVEN ITEMS 

MEAN 
S.D. 



ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


.69 


1.60 


.70 


1.57 


.67 


1.61 


.67 


1.59 


.55 


1.63 


.59 


1.65 


.70 


1.56 


.66 


1.59 


.59 


1.62 


.52 


1.63 


.59 


1.63 


.59 


1.64 


.71 


1.57 


.72 


1.56 


.70 


1.57 


.71 


1.57 


.56 


1.54 


.57 


1.58 


.72 


1.56 


.70 


1.58 


.60 


1.55 


.55 


1.53 


.58 


1.58 


.57 


1.58 


.56 


.87 


.57 


.88 


.53 


.85 


.53 


.85 


.58 


.93 


.56 


.95 


.54 


.86 


.50 


.83 


.59 


.93 


.55 


.93 


.60 


.95 


.50 


.95 


.53 


.86 


.54 


.85 


.52 


.86 


.51 


.86 


.45 


.85 


.46 


.86 


.52 


.84 


.49 


.86 


.46 


.87 


.45 


.84 


.48 


.86 


.47 


.86 


.47 


.86 


.49 


.85 


.45 


.85 


.45 


.85 


.41 


.87 


.41 


.88 


.48 


.85 


.42 


.85 


.46 


.87 


.38 


.87 


.42 


.88 


.42 


.87 


.40 


.84 


.39 


.85 


.41 


.84 


.39 


.86 


.35 


.74 


.23 


.78 


.39 


.86 


.39 


.86 


.33 


.77 


.37 


.73 


.22 


.78 


.21 


.79 


.44 


.75 


.46 


.74 


.40 


.75 


.43 


.75 


.31 


.73 


.30 


.75 


.45 


.74 


.40 


.76 


.37 


.73 


.25 


.74 


.33 


.76 


.20 


.76 


.73 


1.71 


.75 


1.69 


.70 


1.7» 


.72 


1.70 


.60 


1.78 


.66 


1.78 


.75 


1.66 


.69 


1.72 


.63 


1.79 


.55 


1.78 


.70 


1.76 


.60 


1.79 


.76 


1.67 


.78 


1.64 


.74 


1.69 


.75 


1.65 


.67 


1.74 


.72 


1.73 


.76 


1.62 


.73 


1.68 


.73 


1.72 


.61 


1.75 


.74 


1.72 


.69 


1.75 


.59 


1.19 


.60 


1.18 


.57 


1.20 


.57 


1.19 


.50 


1.20 


.50 


1.22 


.59 


1.17 


.55 


1.19 


.53 


1.21 


.47 


1.20 


.52 


1.21 


.47 


1.22 


.13 


.40 


.13 


.39 


.13 


.41 


.13 


.40 


.12 


.43 


.15 


.42 


.13 


.38 


.13 


.41 


.12 


.42 


.11 


.43 


.16 


.42 


.16 


.43 
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For the s >phomore- senior cohort (Tables 9 and 10), the reliabilities 
and SEM's shov .he same pattern of Improvement as did the total scores when 
going from sophomore to senior years* The reliabilities tend to be generally 
low for the geometry (8 items) and chemistry (3 items) subtests for all 
sophomore subpopulations, but especially so for blacks and hispanics. Since 
there is a proportionally greater improvement in these reliabilities for 
blacks and hispanics as one goes from sophomore to senior status, one can only 
suspect that blacks and hispanics are less likely than whites to have already 
had the advantage of exposure to the geometry and chemistry content at the 
scphomore level. An even more surprising finding is that the reliability of 
the biology parcel is relatively low at the sophomore level and did not 
improve for seniors. It may be that the time lapse between taking biology and 
achieving senior status led to considerable forgetting and thus more guessing 
by seniors* 

In summary, there was little change In reliability or standard errors of 
measurement (SEM 9 s) on comparable subtest measures (e.g., reading passages) 
when NLS 1972 seniors and 1980 HSB seniors were compared. There is, however, 
with the exception of the biology parcel, a consistent gain in reliability of 
the subtest scores as one goes from sophomore to senior year. There is also a 
proportionately greater gain in the reliabilities for those subtests 
(especially for minorities) where formal exposure to test content would be 
unlikely at the sophomore level. The initial low reliability of the biology 
parcel, and its lack of gain In reliability with senior status, suggests that 
one would not consider estimating individual gains in the content area defined 
by this parcel. In general, the reliability of the subtent parcels is not 
sufficient to justify their use in measuring gains at the individual level. 
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It is possibls that science score gains might be computed two ways — one with 
the biology items included and one with them excluded. 
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Table 9 



VOCABULARY: 
000 ITEMS 
EVEN ITEMS 

READING*. 
PASSA6E 1 
PASSAGE 2 
PASSAGE 3 
PASSAGE 4 
PASSAGE 5 

MATH* 
ALGEBRA 
ARITHMETIC 
GEOfttTRY 

SCIENCI : 
BIOLCGY 
CHEMISTRY 
PHYSICS 
EARTH SCIENCE 
SCI. METHOD 

WRITING: 

PUNCTUATION 
STYLE 

CIVICS 5 



HSB 1980 SOPHOMORES 
RELIABILITY OF SUBSCORES 
( RIGHTS-ONLY SCORING) 



TOTAL 



MALE 



FEMALE 



WHITE 



BLACK 



HISPANIC NH MALE WH FEMALE 8L MALE BL FEMALE H MALE H FEMALE 



ILPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


.69 


1.40 


.69 


1.40 


.69 


1„3« 


.68 


1.37 


.57 


1.45 


.60 


1.46 


.68 


1.37 


.68 


1.36 


.57 


1.44 


.56 


1.45 


.58 


1.45 


.62 


1.46 


.65 


1.30 


.65 


1.28 


.65 


1.32 


.62 


1.27 


.55 


1.36 


.55 


1.37 


.60 


1.24 


.62 


1.30 


.57 


1.36 


.52 


1.36 


.54 


1.36 


.55 


1.37 


.44 


.77 


.47 


.76 


.41 


.77 


.41 


.73 


.39 


.86 


.42 


.86 


.44 


.72 


.38 


.74 


.43 


.84 


.35 


.86 


.^7 


.84 


.35 


.87 


.36 


.87 


.35 


.88 


.40 


.85 


.38 


.87 


.28 


.84 


.24 


.04 


.35 


.88 


.40 


.86 


.29 


.85 


.26 


.82 


.23 


.85 


.24 


.81 


.44 


.87 


.45 


.88 


.44 


.86 


.44 


.86 


.32 


.87 


.29 


.90 


.45 


.87 


.43 


.85 


.37 


.86 


.28 


.87 


.28 


.91 


.30 


.88 


.50 


.85 


.51 


.84 


.50 


.85 


.50 


.86 


.42 


.80 


.34 


.83 


.50 


.85 


.49 


.86 


.45 


.79 


.39 


.81 


.33 


.83 


.35 


.82 


• 37 


.72 


.40 


.72 


.35 


.71 


.38 


.73 


.17 


.64 


.22 


.68 


.41 


.73 


.35 


.73 


.16 


.65 


.19 


.63 


.23 


.69 


.20 


.68 


.70 


1.46 


.73 


1.46 


.66 


1.47 


.68 


1.45 


.57 


1.48 


.61 


1.49 


.71 


1.45 


.64 


1.45 


.62 


1.47 


.53 


1.48 


.64 


1.49 


.57 


1.49 


.78 


1.86 


.80 


1.85 


.76 


1.87 


.78 


1.85 


.63 


1.87 


.67 


1.90 


.80 


1.83 


.75 


1.86 


.65 


1.86 


.62 


1.88 


.68 


1.90 


.67 


1.88 


.52 


1.20 


.56 


1.20 


.46 


1.19 


.53 


1.20 


.27 


1.14 


.27 


1.18 


.57 


1.20 


.47 


1.20 


.29 


1.15 


.25 


1.13 


.32 


1.19 


.19 


1.17 



.32 


1.05 


.33 


1.04 


.31 


1.06 


.« 


1.04 


.25 


1.08 


.31 


1.08 


.27 


1.02 


.24 


1.05 


.24 


1.07 


.24 


1.09 


.32 


1.06 


.29 


1.10 


.26 


.78 


.32 


.77 


.17 


.78 


.28 


./« 


.07 


.76 


.12 


.77 


.34 


.78 


.19 


.79 


.11 


.76 


.04 


.76 


.14 


.77 


.10 


.77 


.52 


.70 


.52 


.67 


.48 


.73 


.43 


.68 


.41 


.73 


.47 


.75 


.40 


.64 


.42 


.72 


.47 


.74 


.30 


.73 


.49 


.74 


.38 


.76 


.38 


.77 


.42 


.74 


.32 


.80 


.34 


.74 


.33 


.85 


.32 


.85 


.38 


.71 


.28 


.78 


.35 


.83 


.29 


.87 


.40 


.82 


.20 


.88 


.46 


.87 


.49 


.87 


.44 


.87 


.44 


.87 


.34 


.85 


.37 


.88 


.47 


.86 


.41 


.87 


.38 


.85 


.30 


.85 


.3* 


.88 


.35 


.87 


.62 


1.01 


.60 


1.04 


.59 


.98 


.60 


.99 


.56 


1.06 


.55 


1.07 


.60 


1.03 


.55 


.95 


.53 


1.06 


.56 


1.05 


.51 


1.08 


.57 


1.05 


.74 


1.42 


.73 


1.45 


.72 


1.39 


.72 


1.39 


.64 


1.49 


.66 


1.49 


.72 


1.43 


.69 


1.35 


.62 


1.47 


.63 


1.50 


.65 


1.48 


.65 


1.50 



OOD ITEMS 


.40 


.94 


.42 


.94 


.37 


.94 


.39 


.92 


.27 


.99 


36 


.98 


.42 


.92 


.35 


.92 


.24 


1.00 


.29 


.99 


.36 


.99 


.36 


.98 


EVEN ITEMS 


.29 


1.04 


.33 


1.04 


.26 


1.03 


.29 


1.04 


.17 


1.04 


.23 


1.04 


.33 


1.04 


.2S 


1.03 


.18 


1.05 


.16 


1.04 


.23 


1.04 


.21 


1.03 


MEAN 


.50 


1.05 


51 


1.04 


.47 


1.05 


.48 


1.03 


.38 


1.06 


.40 


1.07 


.50 


1.03 


.45 


1.03 


.40 


1.06 


.36 


1.06 


.41 


1.07 


.38 


1.07 


S.D. 


.15 


.31 


.15 


.31 


.16 


.31 


.15 


.30 


.16 


.32 


.16 


.32 


.15 


.31 


.16 


.30 


.16 


.32 


.16 


.32 


.16 


.32 


.17 


.32 
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Table 10 



H9B 1982 SENIORS 
RELIABILITY OF 9UBSC0RE3 
C RIGHTS-ONLY SCORING I 



TOTAL 



KALE 



FEMALE 



MflTE 



SLACK 



HISPANIC NH HALE UH FEMALE SL MALE BL FEMALE H MALE H FEMALE 



VOCABULARY: 
ODO ITEMS 
EVEN ITEMS 

READING: 
PASSAGE 1 
PASSAGE 2 
PASSAGE 3 
PASSAGE 4 
PASSAGE 5 

MATH: 
ALGEBRA 
ARITHMETIC 
GEOMETRY 

SCIENCE: 
BIOLOGY 
CHEMISTRY 
PHYSICS 
EARTH SCIENCE 
SCI. METHOD 

MRniNG: 
PUNCTUATION 
STYLE 

CIVICS: 
ODO ITEMS 
EVEN ITEMS 

MEAN 
S.O. 

















































ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 


SE 


ALPHA 








Al DMA 


tie 


ALTOA 


5c 


Al Mil 

ALraA 


•p 
SE 


ALPHi. 


SE 


ALPHA 


SE 


ALPHA 


SE 


.75 


1.34 


• 74 


1.34 


.75 


1.33 


.73 


1.30 


•68 


1.42 


fcO 


1 63 

A • Yw 


T9 
• 9 C 


1 T1 


• 7Z 


X .Zt 


•by 


1 Al 

X. OX 


A v 

• 67 


1 A V 

X«03 


•68 


1 A V 

X.43 


A A 

•69 


1.43 


.72 


1.25 


.72 


1.21 


.72 


1.27 


.68 


1.20 


.63 


1.36 


.66 


1.33 


.68 


1.17 


.69 


1.23 


•66 


1.33 


.58 


1.38 


.68 


1.30 


.63 


1.36 


•45 


.74 


•50 


.72 


• 39 


.75 


• 42 


•69 


•40 


AA 


61 


A6 


60 


AT 
• Of 


• 35 


7H 

. 70 


• 07 


mm 

• OZ 


• 33 


mm 

• WW 


AE 

• 45 


.83 


YA 

• 36 


• 86 


.47 


.86 


.44 


.86 


.48 


.85 


•48 


.85 


.29 


.85 


.34 


.85 


.46 


.86 


.49 


.85 


.24 


.67 


.32 


.83 


.30 


.86 


.38 


.83 


.48 


.85 


•49 


•86 


• 48 


•84 


•48 


•84 


.37 


•86 


36 


AO 


6Q 


AC 


AA 

• ■to 


• 03 


A9 

•OZ 


.87 


• 30 




• 35 


■ A 

• 89 


.34 


• 88 


.55 


.84 


.55 


.84 


.56 


.84 


.54 


.85 


.48 


.81 


.45 


.83 


.53 


.85 


.54 


.85 


.49 


.82 


.46 


.81 


.45 


.83 


.45 


.83 


.46 


.72 


•49 


.72 


• 44 


.72 


• 46 


.73 


• 30 


66 


90 


60 


• HO 


• 99 


AT 


y* 

• 73 


• 30 


• 65 


• Z6 


A V 

•63 


• 31 


• 69 


• 27 


.69 


.74 


1.44 


.76 


1.43 


.72 


1.44 


.73 


1.42 


65 


1 67 

A • ■* 9 


66 

• vv 


1 60 

A »OT 


TA 
. 9 O 


1 Al 

x.ox 


YH 

.70 


1 AT 

X*03 


AE 

•65 


1 AY 

X.47 


.64 


1 AY 

X.47 


•68 


1.50 


•64 


1.47 


•63 


1.81 


.84 


1.79 


.81 


1.82 


.83 


1.79 


.72 


1.85 


.74 


1.87 


• 84 


1.76 


• 81 


1.80 


.73 


1.05 


.70 


1.85 


. 99 


1.86 


79 

• 9 C 


1 A7 
A .Or 


.61 


1.17 


.64 


1.17 


.57 


1.16 


.62 


1.17 


.38 


1.13 


.40 


1.17 


.64 


1.17 


.58 


1.16 


.44 


1.14 


• 30 


1.12 


.44 


1.18 


• 34 


1.16 


• 32 


1.02 


.33 


1.01 


.31 


1.03 


.24 


1.01 


.33 


1.05 


.29 


1.06 


.26 


1.00 


.2c 


1.01 


.31 


1.03 


.33 


1.06 


.32 


1.05 


.26 


1.08 


•36 


.76 


.43 


.75 


.26 


.77 


.37 


.77 


.16 


.74 


.23 


.75 


.44 


.75 


.27 


.78 


.17 


.74 


.15 


.75 


.28 


.74 


.15 


.76 


•56 


.67 


.57 


.62 


.52 


>71 


.47 


.64 


.49 


.73 


.51 


.74 


.44 


.58 


.44 


.69 


.54 


.73 


.38 


.74 


.53 


.72 


.44 


.76 


.41 


.76 


.44 


.73 


.36 


.79 


.36 


.74 


.34 


.83 


.39 


.82 


.38 


.70 


.32 


.77 


.41 


.81 


.25 


.85 


.42 


.81 


.35 


.84 


.51 


.85 


.54 


.84 


.47 


.86 


.47 


.84 


.38 


.85 


.45 


.86 


.52 


.83 


.42 


.86 


.42 


.85 


.35 


.85 


.45 


.86 


.45 


•85 


.64 


.97 


.62 


1.01 


.61 


.92 


.62 


.94 


.56 


1.05 


.57 


1.05 


.62 


.98 


.56 


.88 


.52 


1.08 


.57 


1.02 


.54 


1.07 


.57 


1.02 


.78 


1.33 


.78 


1.38 


.76 


1.29 


.76 


1.29 


.72 


1.46 


.74 


1.44 


.77 


1.34 


.72 


1.23 


.71 


1.45 


.71 


1.46 


.72 


1.46 


.75 


1.43 


.43 


.90 


.44 


.90 


.41 


.89 


.40 


.87 


.34 


.99 


.39 


.97 


.42 


.87 


.38 


.86 


.38 


.98 


.31 


.99 


.40 


.97 


.36 


.96 


.42 


1.00 


.45 


1.00 


.40 


.99 


.41 


.99 


.33 


1.03 


.36 


1.03 


.44 


.99 


.38 


.98 


.37 


1.03 


.31 


1.03 


.35 


1.03 


.37 


1.02 


.55 


1.01 


.57 


1.01 


.53 


1.02 


.53 


1.00 


.45 


1.05 


.47 


1.06 


.55 


.99 


.50 


1.00 


.47 


1.05 


.42 


1.05 


.48 


1.06 


.45 


1.06 


• 15 


• 29 


• 14 


• 30 


.16 


• 29 


.16 


.29 


.16 


.31 


.16 


.31 


.15 


•29 


.17 


.28 


.16 


• 31 


.17 


• 3x 


.15 


• 31 


.17 


• 31 
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Factor Structure of the Tests 

After investigating the internal consistency of the tests and their 
subtests, it is appropriate to inquire about what the tests are and are not 
measuring; and whether what is measured is the same across cohort groups and 
selected subpopulations within cohorts. Logic ikight dictate that one first 
define what the tests measure and then evaluate their precision. The order is 
reversed here because (1) the reliability estimates are going to be needed for 
the interpretation of the factor analytic results, and (2) we have chosen to 
"mark" our potential factors with reliable parcels or clusters of items that, 
in theory, share common content. Independent estimates of coefficient alpha 
provide some empirical evidence for any subsequent interpretation of these 
subtests as separate homogeneous entities. With the exception of the biology 
parcel, the remaining parcels have reliabilities that are in the "ball park" 
for the number of items included in the parcel. This finding suggests that 
each of the parcels is relatively internally consistent and, as a consequence, 
can be assumed to be a measure of a reasonably homogeneous content area. 
Content areas within a particular discipline, e.g., the content parcels within 
the science area, can then be hypothesized as measures or indicators of a 
science construct or factor in a confirmatory factor analytic solution. 

Past empirical and theoretical studies suggest that any one of three 
possible factor models might fit the present achievement data. The simplest 
model would be a single underlying achievement factor that would adequately 
explain the reliable variance within each parcel. If such a model was 
consistent with the data, one would have to conclude that all parcels were 
measures of z ~_neral knowledge factor. Another model might be a simple 
two- factor model where each parcel is a different combination of, say, a 
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verbal and quantitative factor. This model is consistent with the usual 
findings, where verbal and quantitative measures are factor analyzed, and is 
also similar to the Heyns and Hilton results with HS&B test data. A third 
alternative would be a multiple-factor model where each content area, e.g., 
science, reading, mathematics, etc., define separate but correlated 
achievement factors. A theoretical model consistent with such a result would 
be a general knowledge factor that would cut across each discipline area and, 
in addition, have separate group factors for each discipline area. The 
general factor would generate or underlie the correlations among the grouo 
factors. 

All factors analysis computations were based on the weighted data. Two 
variants of the single-tactor model are estimated first. Table 11 presents 
both the percentage of common .ariince, and the percentage of reliable 
variance explained by a single-factor model, and then by the two-factor model 
described above in Model 2. The first column labeled common factor solution 
shows the percent of common variance explained by the first principal axes of 
the correlation matrix with commonalities on the main diagonal. The 
commonalities were estimated using the multiple correlation squared. 
Inspection of Table 11 indicates that the first factor explains from 97 to 100 
percent of the common variance, depending on cohort group. Using any of 
the traditional criteria for determining the number of factors, one would be 
led to believe that nil paicels were simply different methods of measuring a 
single general knowledge factor. Although Anastasi (1982) argues that the 
general knowledge factor increases in size with increases in population 
heterogeneity, there appears to be more at work here than population 
heterogeneity. 
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Table 11 



Percent of Variance Explained by Selected Factor Analysis Solutions 



POPULATIONS 

1972 SENIORS 
1980 SENIORS 
1980 SOPHOMORES 
1982 SENIORS 



COMMON FACTOR 
SOLUTION 8 

ONE FACTOR 

100% 

100% 

97% 

98% 



PSYCHOMETRIC SOLUTION 0 
ONE FACTOR TWO FACTOR 



SOLUTION 
77% 
79% 
81% 
83% 



SOLUTION 
88% 
90% 
86% 
87% 



8 Principal axes with R 2 on main diagonal 

0 Maximum likelihood solution showing percent of reliable variance 
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The traditional factor analytic approach to explaining common achievement 
test variance, rather than reliable test variance, seems to be partially 
responsible for this unexpected factor space degeneration. The columns under 
the label "psychometric solution" show the percent of reliable variance 
explained by a maximum likelihood solution (MLH) for the single-factor (Model 
1) and the two-factor (Model 2) models. The situation improves considerably 
with a single general factor explaining from 77 to 83X of the reliable 
variance depending on the cohort. The two-factor model explains from 87 to 
90% of the reliable variance. These percentages of reliable variance are 
probably slightly overestimated, since coefficient alpha is generally a lower 
bound estimate of the test-retest reliability. The results of this 
partitioning of the reliable variance suggest that the two-factor model would 
provide a good starting point for the confirmatory factor analysis. 

1972-1980 Cross- sectional Comparison of Factor Patterns 

xdble 12 presents the factor loading pattern coefficients for the two- 
factor solution for the NLS 1972 and HS&B 1980 seniors. The factor loadings 
for HS&B 1980 seizors are shown in parenthesis (). This is a maximum 
likelihood confirmatory factor analytic solution with parameters estimated by 

the LISREL VI computer program (Joreskog & Sorbom, 1983). Consistent with 
the factor analytic results in the literature, a verbal and a math factor were 
defined by the vocabulary and math subtests. Inspection of the factor loadings 
in Table 12 indicates that the two vocabulary parcels and the two math parcels 
were constrained to have zero loadings on the math and vocabulary factors 
respectively. These constraints served two purposes. First, they defined a 
relatively "pure" verbal factor and a "pure" math factor. Second, they made 



the model identified which, in turn, alicfoed LISREL to find a unique solution 
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Table 12 



Two Factor Total Sample Cross-Sectional Solution for 1972 and 1980 

SENIORS ( ) 



VARIABLE 



FACTOR l a FACTOU 2 a 



INTERNAL 

CONSISTENCY 

RELIABILITIES 



RELIABLE 

UNEXPLAINED 

VARIANCES 



VOCABULARY ODD 


82 


(b4; 


0 


(0) 


66 


(69) 


1 


(0) 


VOCABULARY EVEN 


76 


(83) 


0 


(0) 


63 


(71) 


5 


(2) 


READING PASSAGE 1 


44 


(43) 


21 


(24) 


53 


(56) 


17 


(17) 


READING PASSAGE 2 


43 


(41) 


28 


(30) 


52 


(53) 


9 


(9) 


READING PASSAGE 3 


49 


(45) 


18 


(23) 


47 


(47) 


9 


(7) 


READING PASSAGE 4 


50 


(51) 


9 


(7) 


42 


(40) 


10 


:9) 


READING PASSAGE 5 


43 


(39) 


23 


(18) 


54 


(44) 


17 


(15) 


MATHEMATICS ODD 


0 


(0) 


89 


(85) 


77 


(73) 


0 


(1) 


MATHEMATICS EVEN 


0 


(0) 


88 


(88) 


75 


(76) 


0 


(0) 



RMS - .026 (.027) 
CFI - 978 (976) 



Percentage of Reliable Variance .... 87.8 (90.0) 

r - .69 (.7?) 
F!F 2 



a Decimal points have been omitted. 
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to the maximum likelihood equations. The reading parcels were left "free" to 
load on either the verbal or math factor, under the -ssumption that some of 
the reading passages with heavy scientific emphasis might also load on the 
math factor. In fact, there is some tendency to uo just that as indicated by 
the second passages and, to a lesser extent, the fifth passage. Both passages 
had a scientific theme. 

The internal consistency reliability estimates are the coefficient alphas 
discussed earlier, last two columns are the differences between the 

amount of a variable's variance that can be explained by the underlying verbal 
and math factors and that variable's reliability. For example, 66% of the 
observed variance in the odd vocabulary items is true or systematic variance. 
Of the 66%, ail but 1% was explained by the verbal factor. Similarly, in 
1972, 53% of the first reading passage variance was true or reliable variance. 
Only 36% (53-17) of this reading passage's variance can be explained by the 
verbal and math factor. Thus, 32 percent of the first reading passage's 
reliable variance (17/53) was not explained by the two-factor model. The two 
variables that seem to have reliable variance that is not explained by the 
2-f actor model are the first and fifth reading pasrage. This result is true 
for both the 1972 and 1980 seniors. The first reading passage has a black 
literature orientacion, whereas, the fifth passage has a scientific theme. 

The similarities in the factor structure for both Senior classes are 
much more striking than are any of the differences. In general, the pattern 
of loadings is almost identical with slight cceptions where the reliabilities 
might have differed from one cohort to another. 
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The factor intercorrelations are about the size that one has come to 
expect between verbal and math factors. 

It should be noted that the factor intercorrelatlon can be considered to 
be corrected for attenuation. That is, the correlation between the verbal 
factor and the math factor is not attenuated by measurement errors* 

Although the LISREL program produces standard errors and x^'s * or testing 
the overall model fit, they will not be reported here, since we have chosen to 
standardize the variables and deal with the correlation matrix for ease of 
interpretation. The x^ tests and standard errors associated with standardized 
variables do not have their usual meaning. To insure that one wouldn't come 
to substantively differing conclusions if one factored the variance-covariance 
matrices (rather than correlations), parallel analyses were run on the 
variance-covariance matrices, 

In lieu of the x^ measure of the overall goodness of fit of the model, we 
provide the root mean square residual (RMS) which is the average correlation 
among the residuals after fitting the model. The RMS's of ,026 and .027 for 
1972 and 1980 are sufficiently low to suggest a good fit. LISREL provides one 
other measure of goodness of fit that, like the RMS, is independent of sample 
size and that is the GFI. The GFI varies between 0 and 1, where one (1) is a 
perfect fit. The very high GFI's of .978 and .976 suggest very good fits for 
both the 1972 and 1980 seniors. 

These results are very similar to the Heyns and Hilton (1962) results, 
except that they a. o included the Picture Number and Mosaic Comparison. They 
did rot, however, deal with separate reading passages. They found that 
verbal, math and a third, unnamed, factor seemed to be sufficient to explain 
the intercorrelations among the tests. 
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The possibility of a model three fit was investigated by examining the 
correlations among the reading passage residuals to see if there was any 
possibility of defining a separate reading factor. No systematic psttern of 
residuals suggesting a common reading factor was found. Evidently, any part 
of the reliable variance in the reading passages that was not explained by the 
verbal and math factor was probably due to the content specific nature of the 
passage. 
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Comparisons of Factor Patterns for Sophomore and Senior Cohorts 
Table 13 presents a two-factor (Model II) solution for the sophomore 
subtest scores and then again for the same group as seniors. The senior 
factor loadings are shown in parethenses. The same math-verbal two-factor 
pattern of constraints on the factor loadings was used for both sophomores and 
seniors. Since there are now 19 observed variables, it was decided to 
increase the number of zero constraints to overidentify the two-factor model. 
With this in mind, the reading passages' loadings were constrained to zero on 
the "pure" math factor. That is, they served as additional marker variables 
that have been constrained by the model to be zero are underlined. Thus, the 
vocabulary and reading passages were the "marker" variables for the "pure" 
verba] factor and the t* ree math subtests served as markers for the math 
factor. The science, writing, and civics subtests were free to load at will. 

Inspection of the loadings suggests that even with 19 obseved variables 
measuring 6 potential achievement areas (vocabulary, reading, math, science, 
writing and civics), two factors seem to explain virtually all of '.he reliable 
variance. That is, the verbal and math factors explain 85.8% of the reliable 
variance for the sophomores and 87.0% of the reliable variance for the 
seniors. With the exception of the writing subtests and the physics subtest, 
the remaining subtests' reliable variances seem to be explained by a linear 
function of the verbal and math factors. These conclusions apply equally to 
both the sophomore and senior results. It is also interesting to note that 
physics and chemistry tend to liave complex loadings, i.e., load on both the 
verbal and math factors, whereas the remaining science subtests load primarly 
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Tf.ble 13 



Two Factor Maximum Likelihood Solution for HS&B Sophomores and Seniors ( ) 



INTERNAL 
CONSISTENCY 



RELIABLE 
UNEXPLAINED 



VARIABLE 


FACTOR 1* 


FACTOR 2 a 


RELIABILITY 


VARIANCES 


VOCABULARY ODD 


77 


(81) 


0 


(0) 


69 


(75) 


9 


(10) 


VOCABULARY EVEN 


76 


(80) 


0 


(0) 


65 


(72) 


7 


(7) 


READING PASSAGE 1 


61 


(64) 


0 


(0) 


44 


(45) 


7 


(5) 


READING PASSAGE 2 


57 


(63) 


0 


(0) 


38 


(47) 


5 


(7) 


READING PASSAGE 3 


64 


(67) 


0 


(0) 


44 


(48) 


3 


(3) 


READING PASSAGE 4 


67 


(70) 


0 


(0) 


50 


(56) 


6 


(6) 


READING PASSAGE 5 


53 


(60) 


0 


(0) 


37 


(46) 


8 


(10) 


MATHEMATICS- ALGEBRA 


0 


(0) 


84 


(86) 


70 


(74) 


0 


(0) 


MATHEMATICS-ARITHMETIC 


0 


(0) 


87 


(89) 


77 


(83) 


1 


(3) 


MATHEMATICS-GEOMETRY 


0 


(0) 


69 


(75) 


51 


(61) 


3 


(5) 


SCIENCE-BIOLOGY 


47 


(51) 


8 


(5) 


32 


(32) 


3 


(2) 


SCIENCE-CHEMISTRY 


30 


(29) 


17 


(26) 


26 


(36) 


6 


(8) 


SCIENCE-PHYSICS 


30 


(33) 


34 


(32) 


52 


(56) 


15 


(17) 


SCIENCE-EARTH SCIENCE 


40 


(42^ 


13 


(15) 


38 


(41) 


11 


(11) 


SCIENCE-METHODOLOGY 


60 


(68) 


10 


(5) 


46 


(51) 


0 


(0) 


WRITING-PUNCTUATION 


35 


(46) 


30 


(21) 


62 


(64) 


23 


(21) 


WRITING-STYLE 


63 


(74) 


13 


(3) 


74 


(78) 


19 


(19) 


CIVICS-ODD 


59 


(70) 


1 


(7) 


40 


(43) 


4 


(2) 


CIVICS-EVEN 


48 


(62) 


3 


(1) 


29 


(42) 


3 


(3) 



FACTOR INTERCORRELATIONS 



RMS 026 (.027) 

GFI 963 (.953) 



Fl 

F2 



Fl 



1 

827(852) 



F2 



Percentage of Reliable 
Variance .... 85.8 (87.0) 



a Decim/.l prints have been omitted. 
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on the verbal factor. Biology and scientific method are almost entirely 
explained by the verbal factor. As expected, the two scientifically oriented 
reading passages (P 2 and P5) had the lowest loadings on the verbal factor 
among the reading passages for sophomores. However, for senior a this 
difference decreases. 

The correlations among the factors are quite high, ,827 for sophomores 
and .852 for seniors. Part of this relatively high correlation may be arti- 
f actual In the sense that we identified the model by constraining the reading 
passages to have zero loadings on the math. If we re-estimate the model 
(which is still identified) relaxing that constraint, the correlation does go 
down to .80 for sophomores and .82 for seniors; and the two scientific reading 
passages have loadings of .15 (P2) and .26 (P5) on the math factor. The 
goodness of fit indices showed little change, and the remaining loadings 
showed little or no change. 

The results seem to indicate that what starts out to be 6 distinct 
achievement areas can best be summarized as linear functions of a verbal 
factor and a math factor. With the exception of physics, the science areas 
reading passages, civics, and of course vocabulary, form a solid verbal 
factor. This pattern is quite stable as one goes from the sophomore to the 
senior year. That is, there ia no change in the pattern of loadings as one 
goes from sophomore to senior. The only change, if any, is the Increase in 
the general level of the loadings probably reflecting the Increase in 
variance, which leads to an Increase in reliability, which in turn is 
reflected in larger loadings. This phenomenon is, of course, consistent with 
a model that argues that the implementation of a treatment (or additional 
treatment) Increases individual differences and the consequences thereof. The 
N bad news" aspect of thsse results is that the lack of specificity in many 
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of the test measures suggests a low probability of finding differential 
curriculum effects on, for example, changes in science achievement over two 
years. The "good news'* aspect is that there is no evidence that what we are 
measuring shows significant changes in structure or meaning over time in the 
total population. It does not appear that we have a problem of apples at one 
time and oranges at another. 

Comparison of sophomore and senior Factor Patterns by Sex Group 

Tables 14 and 15 presents the results of the two-factor model that was 
fitted separately to male and female sophomores and seniors respectively. 
The female loadings are shown in parentheses. Not surprisingly, the factor 
loading patterns for the sex groups are quite similar to each other at both 
the sophomore and senior level and show little or no difference from the total 
population results. The conclusions derived from the total sample apply 
equally well here. 

Comparison of Sophomore- Senior Factor Patterns by Ethnic Gm. jp 

Tables 16 and 17 present comparisons of factor patterns for black and 
white and for hispanic and white sophomores, respectively. Tables 18 and 19 
show the parallel comparisions for 1982 seniors. There is little in the 
black-white comparison that suggests the tests have a different structure and 
thus a possibly different meaning for the two subpopuiations. Although the 
pattern of loadings is ver> similar, there is a general lavei different *n 
loadings that, once again, seems to reflect the pattern of lower reliab. ities 
for blacks. 0n< interesting trend is that there appeals to be a greater 
influence of verbal on black students' performance on the sciences subt ;sts 
than for the whites (e.g., see Table 16). Inspection of the hispanic-white 
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Table 14 

Two Factor Maximum Likelihood Solution For HS&B Male and Female Sophomores ( 



RELIABLE 
UNEXPLAINED 

VARIABLE FACTOR 1 FACTOR 2 RELIABILITIES VARIANCES 



VOC ODD 


77 


(78) 


0 


(0) 


69 


(69) 


10 


(8) 


VOC EVEN 


77 


(78) 


0 


(0) 


65 


(65) 


6 


(A) 


READ PI 


61 


(62) 


0 


(0) 


48 


(41) 


11 


(3) 


READ P2 


56 


(59) 


0 


(0) 


35 


(40) 


4 


(6) 


READ P3 


64 


(63) 


0 


(0) 


45 


(44) 


4 


(4) 


READ PA 


68 


(65) 


0 


(0) 


51 


(50) 


6 


(7) 


READ P5 


54 


(53) 


0 


(0) 


40 


(35) 


10 


(7) 


M-ALG 


0 


(0) 


85 


(82) 


73 


(66) 


0 


(0) 


M-ARITH 


0 


(0) 


88 


(86) 


80 


(76) 


3 


(2) 


M-GEOM 


0 


(0) 


72 


(65) 


56 


(46) 


4 


(3) 


S-BIO 


45 


(50) 


11 


(5) 


33 


(31) 


3 


(2) 


S-CHEM 


35 


(30) 


19 


(9) 


32 


(17) 


4 


(3) 


S-PHYS 


35 


(30) 


29 


(35) 


52 


(48) 


14 


(9) 


S-E.S. 


44 


(41) 


12 


(11) 


42 


(32) 


13 


(6) 


S- METHOD 


63 


(57) 


10 


(9) 


49 


(44) 


0 


(2) 


W-PUNC 


29 


(36) 


40 


(31) 


60 


(60) 


17 


(19) 


W- STYLE 


62 


(62) 


18 


(15) 


73 


(72) 


14 


(15) 


CIV-ODD 


57 


(59) 


4 


(0) 


42 


(37) 


6 


(1) 


CIV-EVEN 


48 


(47) 


5 


(2) 


33 


(26) 


6 


(2) 



r - 82 (83) 
FjF2 

RMS - .024 (.021) 

GFI = .969 (.975) 

Percentage of Reliable Variance ... 86.6 (88.5) 



CO 



Table 15 

Comparison of a 2-Factor Solution for White and Black ( ) 1982 Seniors 



Parcels 




Factor 1 


Factor 2 


VOC ODD 




79 


(77) 


n 
u 




VOC EVEN 


77 


(75) 


n 


(0) 


READING 


PI 


60 


'61) 


0 


(0) 


READING 


P2 


64 


(49) 


0 


(0) 


RI'ADING 


P3 


66 


(61) 


0 


(0) 


READING 


PA 


69 


(62) 


0 


(0) 


READING 


P5 


60 


(42) 


0 


(0) 


M-ALC 




0 


(0) 


86 


(80) 


M-ARITH 




0 


(0) 


89 


(82) 


M-GEOM 




0 


(0) 


76 


(52) 


S-BIOL 




42 


(47) 


07 


(07) 


S-CHEM 




30 


P3) 


26 


(08) 


S-PHYSIC 




21 


(-3) 


37 


(30 * 


S-E.S. 




32 


(39) 


18 


(12) 


S-METH 




64 


(57) 


05 


(11) 


W-PUNCT 




45 


(21) 


19 


(43) 


W- STYLE 




72 


(49) 


02 


(21) 


CIV-ODD 




69 


(54) 


-08 


(05) 


CIV-EVEN 




61 


(54) 


01 


(06) 



r FjF 2 = 83(.79) RMS 029 (.032) 

GFI 951 (.935) 



Reliable 

Reliabilities Unique Variances 



73 


(68) 


11 


(9) 


68 


(63) 


8 


(6) 


42 


(40) 


6 


(2) 


48 


(29) 


7 


(5) 


48 


(37) 


4 


(0) 


54 


(48) 


7 


(10) 


46 


(30) 


10 


(12) 


73 


(65) 


0 


(1) 


83 


(72) 


3 


(5) 


62 


(38) 


4 


(10) 


24 


(33) 


1 


(5) 


37 


(16) 


8 


(7) 


47 


(49) 


16 


(14) 


36 


(34) 


12 


(10) 


47 


(38) 


0 


(0) 


62 


(56) 


24 


(19) 


72 


(72) 


18 


(27) 


40 


(34) 


1 


(1) 


41 


(33) 


2 


(1) 



% of Reliable Varaince Explained .. 
85.3 (83.8) 
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Table 16 

Whlte(Black) Comparison of a Two Factor Solution for 1980 Sophomores 



RELIABLE 
UNEXPLAINED 

VARIABLE FACTOR 1 FACTOR 2 RELIABILITIES VARIANCES 



VOC ODD 


75 


(71) 


0 


(0) 


68 


(57) 


11 


(7) 


VOC EV3N 


73 


(70) 


0 


(0) 


62 


(55) 


9 


(6) 


READ PI 


59 


(56) 


0 


(0) 


41 


(39) 


6 


(8) 


READ P2 


58 


(48) 


0 


(0) 


38 


(28) 


5 


(5) 


READ P3 


63 


(59) 


0 


(0) 


44 


(32) 


5 


(0) 


READ P4 


65 


(59) 


0 


(0) 


50 


(42) 


7 


(6) 


READ PS 


54 


(35) 


0 


(0) 


38 


(17) 


9 


(5) 


M-ALG 


0 


(0) 


83 


(78) 


68 


(57) 


0 


(0) 


M-ARITH 


0 


(0) 


87 


(78) 


78 


(63) 


2 


(2) 


M-GEOM 


0 


(0) 


70 


(46) 


53 


(27) 


4 


(6) 


S-BIO 


39 


(48) 


9 


(5) 


25 


(25) 


4 


(0) 


S-CHEM 


30 


(25) 


19 


(3) 


28 


(7) 


7 


(0) 


S-PHYS 


23 


(30) 


34 


(26) 


43 


(41) 


14 


(12) 


S-E.S. 


32 


(49) 


17 


(-5) 


34 


(33) 


13 


(13) 


S-METHOD 


55 


(58) 


11 


(8) 


44 


(34) 


2 


(7) 


W-PUNC 


33 


(22) 


30 


(39) 


60 


(56) 


25 


(22) 


W- STYLE 


60 


(52) 


13 


(17) 


72 


(63) 


22 


(18) 


CIV-ODD 


57 


(50) 


2 


(3) 


39 


(27) 




(0) 


CIV-EVEN 


45 


(43) 


5 


(3) 


29 


(17) 


4 


(0) 



r - 80 (80) 
F 1 F 2 

RMS - ,028 (.031) Percentage of Reliable Variance .... 83.4 (87.1) 

GFI - 962 (961) 
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Table 17 



White(Hispanic) Comparison of a Two Factor Solution for 1980 Sophomores 



P2 
?3 
P4 
P5 



VARIABLE 

VOC ODD 
VOC EVEN 
READ PI 
READ 
READ 
READ 
READ 
M-ALG 
M-ARITH 
M-GEOM 
S-BIO 
S-CHEM 
S-PHYS 
S-E.S. 
S-METHOD 
W-PUNC 
W-STYLE 
CIV-ODD 
CIV-EVEN 



FACTOR 1 

75 (70) 

73 (69) 

59 (57) 

58 (43) 

63 (55) 

65 (56) 

54 (36) 

0 (0) 



0 
0 



(0) 
(0) 



39 (54) 

30 (30) 

23 (26) 

32 (47) 
55 (60) 

33 (36) 
60 (64) 
5/ (59) 
45 (58) 



FACTOR 2 



RELIABILITIES 



RELIABLE 

UNEXPLAINED 

VARIANCES 



0 


(0) 


68 


(60) 


11 


(11) 


0 


(0) 


62 


(55) 


9 


(8) 


0 


(0) 


41 


(42) 


6 


(9) 


0 


(0) 


38 


(24) 


5 


(6) 


0 


(0) 


44 


(29) 


5 


(0) 


0 


(0) 


50 


(34) 


7 


(3) 


0 


(0) 


38 


(22) 


9 


(9) 


83 


(78) 


68 


(61) 


0 


(0) 


87 


(79) 


78 


(67) 


2 


(4) 


70 


(53) 


53 


(27) 


4 


(0) 


9 


(1) 


25 


(31) 


4 


(2) 


19 


(4) 


28 


(12) 


7 


(1) 


34 


(33) 


43 


(47) 


14 


(15) 


17 


(3) 


34 


(32) 


13 


(8) 


11 


(3) 


44 


(37) 


2 


(0) 


30 


(25) 


60 


(55) 


25 


(21) 


13 


(5) 


72 


(66) 


22 


(19) 


2 


(-6) 


39 


(36) 


4 


(7) 


5 


(-16) 


29 


(23) 


4 


(3) 



r - 80 (84) 
F!F 2 



RMS - .028 (.028) 
GFI - 962 (966) 



Percentage of Reliable Variance 



83.4 (84.1) 



03 
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compari8on in Table 17 also shows a greater overlap of verbal and the science 
subtest 8 for hispanics. It may be that blacks and hispanics are more likely to 
come from home and school environments offering less opportunity to learn about 
the scientific concepts addressed by the subtest. As a result, their performance 
depends, to a greater extent, un general verbal knowledge. That is, if certain 
subpopulatlons either do not have the opportunity or, for whatever reason, are 
less likely to take advantage of the opportunity, to take additional instruction 
in specialized areas, we would expect their correlational structure on 
achievement tests to be driven by a general verbal factor. 

Tables 18 and 19 present the factor loading coefficients and accompanying 
goodness of fit indices for white-black and white-hispanic senior comparisons, 
respectively. Generally the pattern of salient and nonsalient loadirgs are quite 
similar to the sophomore results. One main difference is that the loadings for 
all groups show slight increases, which, in turn, reflect the increase in 
between-individual variation (and thus reliability) that is due to continuation 
of the educational treatment. Although the "treatment" may have increased 
between-individual variation within each achievement area, it did not appear to 
significantly increase the differentiation between the verbal and quantitative 
factor. Inspection of possible patterns among the normalized residuals did not 
reveal systematic patterns that would suggest the possibility that additional, 
albeit small, factors were present. However, small correlated residuals were 
found between the fifth reading passage (science orientation) and the geometry 
parcel. Similar sized residuals were found between the physics parcel and the 
earth science scientific parcel. These correlated residuals, while not 
statistically significant, occurred in all three subpopulatlons. 
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Table 18 



Comparison of a 2-Factor Solution for Male and Female ( ) 1982 Seniors 



Parcels 

VOC ODD 

VOC EVEN 

READING PI 

READING P2 

READING P3 

READING PA 

READING P5 

M-ALG 

M-ARITH 

M-GEOM 

S-BIOL 

S-CHEM 

S-PHYSIC 

S-E.S. 

S-METH 

W-PUNCT 

W- STYLE 

CIV-ODD 

CIV-EVEN 



Factor 1 Factor 2 



80 (83) 
80 (82) 
64 (64) 
62 (65) 
67 (6C) 
71 (70) 
62 (58) 

0 

0 

0 

52 (51) 
40 (27) 
44 (33) 
50 (44) 
70 (67) 
33 (47) 
70 (71) 
69 (67) 
57 (62) 



0 
0 
0 

0 
0 
0 
0 

88 (85) 
90 (88) 
76 (72) 
04 (03) 
22 (20) 
21 (33) 
08 (10) 
04 (03) 
38 (23) 
20 (06) 
-04 (05) 
07 (-1) 



Reliabilities 

74 (75) 
72 (72) 
50 (39) 
44 (48) 
49 (48) 
55 (56) 
49 (44) 
7 6 (72) 
84 (81) 
64 (57) 
33 (31) 

43 (26) 
57 (52) 

44 (36) 
54 (47) 
62 (61) 
78 (76) 

44 (41) 

45 (40) 



Reliable 
Unique Variance 



11 (07) 
08 (02) 

10 (0) 
06 (06) 
05 (02) 
05 (07) 

11 (10) 
(0) 

(03) 
(06) 
(02) 
08 (05) 
17 (09) 
11 (07) 

0 (0) 
14 (16) 
14 (17) 

1 (02) 
* (02) 



0 
2 
4 
2 



r Fi p 2 - 85(.85) RMS 023 (.023) % of Reliable Varainc 87.4 (89.2) 

GFI 959 (.967) 



0 
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Table 19 



Compariso n of a 2-Factor Solution for White and Hispanic ( ) 1982 Seniors 



Parcels 

VOC ODD 

VOC EVEN 

READING PI 

READING P2 

READING P3 

READING P4 

READING P5 

M-ALG 

M-ARITH 

M-GEOM 

S-BIOL 

S-CHEM 

S-PHYS1C 

S-E.S. 

S-METH 

W-PUNCT 

W- STYLE 

CIV-ODD 

CIV-EVEN 



Factor 1 Factor 2 Reliabilities 



79 (76) 
77 (75) 
60 (60) 
64 (54) 
66 (58) 
69 (63) 

60 (46) 
(0) 
(0) 
(0) 

42 (59) 
30 (23) 

21 (38) 

22 (42) 
64 (66) 
45 (63) 
72 (93) 
69 (71) 

61 (67) 



0 
0 
0 



0 

0 
0 
0 
0 

0 



(0) 
(7) 
(0) 
(0) 
(0) 
(0) 

* (0) 
8? (81) 
89 (84) 
76 (60) 
07 (-08) 
26 (19) 
37 (24) 

18 (11) 
05 (01) 

19 (03) 
02 (-19) 

-08 (-14) 
01 (-13) 



/3 (69) 

68 (66) 

42 (41) 

48 (34) 

48 (34) 

54 (45) 

46 (29) 
73 (66) 
83 (74) 
62 (40) 
24 (29) 
37 (23) 

47 (51) 
36 (39) 
47 (45) 
62 (57) 
72 (74) 

40 (39) 

41 (36) 



Reliable 
Unique Variance 

11 (ID 
8 (10) 

6 (5) 

7 (5) 
4 (0) 

7 (5) 
10 (7) 

0 (0) 

3 (3) 

4 (5) 

1 (2) 

8 (7) 
16 (15) 

12 (12) 

0 (0) 
24 (15) 
18 (14) 

1 (4) 

2 (4) 



r FjF 2 " 83(.86) RMS 029 (.029) X of Reliable Varaince Explained .... 85.3 (86.0) 

GFI 951 (.957) 
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Simllar to the sophomore cohort finding, there remains the greater 
saturation of the verbal factor of hispanic performance on both the science 
parcels and the writing parcels. Obviously, verbal language skills are 
critical to hispanics for performance in science as well as writing. As 
pointed out earlier in connection with the black-white contrast at the 
sophomore level, there is some evidence that performance on science for black 
seniors is more heavily tied to general verbal ability than is the case for 

Whit 68. 

A technical note is in order here. From a statistical viewpoint, the 
preferable method of comparing factor patterns across populations is to 
analyze the variance-covariance matrices, rather than the correlation matrix. 
The theoretical advantage of factoring the variance-covariance matrix is that 
the factor loadings will be less affected by changes in the relative 
variability of the traits under examination from one population to another. 
The MLH factor loadings estimated on variance-covariance data are the raw 
score regression weights of the observed variables on the factors and thus 
relatively invariant with respect to selection. The problem with the 
variance-covariance approach la that interpretation of the resulting loadings 
in their original metric is often meaningless. In this case, all analyses 
were run twice, once on the correlation matrix and once on the 
variance-covariance matrix. Both runs were then inspected to insure that the 
same conclusion would be drawn about the salient loadings within each 
population. 

Inspection of the variance-covariance generated factor loadings revealed 
the same general pattern of loadings ao was found in the standardized 
solution. However, the original difierence between whites and blacks and 
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between whites and hispanics in the general level of the loadings was somewhat 
reduced. This is to be expected, since the reduced variances in both the 
black and hispanic population *ould have less effect on the unstandardized 
factor loadings* 

In summary, there is little if any change in factor structure either 
crose-sectiorally (i.e., when comparing senior cohorts) or in the longitudinal 
analysis of the sophomore-senior transition. With the exception of writing 
style, punctuation parcels, and the physics parcel, the remaining parcels seem 
to possess little or no unique reliable variance beyond that which can be 
explained by a verbal and/or math factor. Black and hispanic factor 
structures are quite similar to white structures with the exception that 
performance on the science measures has * larger verbal component for 
hispanics than for whites. A similar, although less pronounced finding, 
occur 8 when comparing the black and white structures. One somewhat surprising 
result is that there is no increased differentiation between the verbal and 
math factors when going from sophomore to senior status (as measured by the 
factor intercorrelation) . However, there is increased differentiation between 
individuals (as measured by increased test score variance) as the transition 
from sophomore to senior occurs. It is possible that more achievement factors 
and additional factor differentiation would emerge if populations were defined 
by curriculum. Individuals in the academic curriculum would be more likely to 
take additional specialized courses in areas of particular interest or skill. 
This should lead to more differentiation. In sum, there is little empirical 
evidence for the notion that the tests or test parcels measure different 
things for different ethnic or sex groups. 
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Scorlng and Equating Using Item Response Theory (IRT) 
Item Response Theory (IRT) was used to score tests within population 
(1980-1982) and to score and equate tests across populations. IRT methods 
were used to put mathematics, vocabulary, and reading scores on the same scale 
for 1972, 1980, and 1982 sen'srs. Similarly, IRT methods were used to score 
all the HS&B tests given to individuals as sophomores and repeated as seniors. 
The three parameter IRT model was selected over the one and two parameter 
models because of the possibility that guessing and/or speededness might be 
additional confounding sources of variance* Item response theory describes 
the probability of answering an item correctly as a mathematical function of 
ability level or skill. The mathematical function used here, the logistic 
function, has one parametet for each individual — ability level — and three 
parameters characterizing each item (Lord, 1980, Lord & Novick, 1968). The 
item parameters reflect difficulty level (b£) , discriminating power (a^, and 
the likelihood of low ability individuals guessing the right answer (c^). The 
function that relates the probability of passing a particular item 1 for a 
person of ability 6 in terms of the item parameters is: 

?i <e> - c t + (i-ci> IRexp - Da |(e - bi )] <» 

where D s 1.7 

b^ - item difficulty corresponding to the value of 6 halfway between 

the guessing parameter and 1.0 
a± ■ discrimination parameter reflecting the steepness of the item 

characteristic curve at its point of inflection 

Qr. 
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H * "guessing parameter" probability of a person with very low abilit; 
getting the item correct 

6 * a person's ability parameter usually standardized with mean 0 and 
standard deviation of 1.0 
and Pi(6) - probability of correct response of a person of ability level 6. 

A person's number right true score (NRTS) is the simple sum of that 
particular person's ? ± (Q)'s. Thus, the scoring weights each item receives in 
the summation to arrive at NRTS are a function of the interaction of the item 
parameters with the person's 6 or ability level. That is, the item 
characteristic functions, ? ± (Q)'g, provide a different score for a given item, 
depending upon a person's ability level. Inspection of the item 
characteristic function in equation (1) suggests chat, for high ability 
people, the item score for a given item i will primarily depend on how much 
higher the person's 6 is compared to the item difficulty (b 4 , also measured in 
8 units), and how discriminating the item is. 

A low-ability person will get little credit on a difficult item , even if 
he or she were to get it correct, because the model argues that the correct 
answer was probably guessed. This readily follows from equation (1). Such a 
person might have a 6 (ability level) that was negative, say -1.5, and the b ± 
for a difficult item on the 6 scale might be 2.0, and, since a t is always 
positive, the denominator of equation (1) would become large in relation to 
the numerator. The limit here as the denominator gets larger is a scoring 
weight Pi(e) equal to c A the guessing parameter. 

The fact that the item scores that are summed to get the number right 
true score are a function of the person's ability level 6, discrimination, 
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difficulty, and guessing parameters, suggests that IRT scoring can be 
beneficial if (1) people with low ability can get the right answer by 
guessing; (2) items in the test vary in both difficulty and discrimination and 
thus an optimal scoring procedure should take this into account; (3) there are 
test center administration irregularities with respect to directions or timing 
that may lead to varying levels of items attempted and (4) the purpose 
is to put tests that share some but not all of the smae items on the same scale. 

The ability of IRT methods to deal with individuals or groups characterized 
by differences in the propensity to attempt items is particularly pertinent here 
for appropriate cross-sect? onal comparisons between the seniors of 1972 and the 
seniors of 1980. As pointed out earlier in this report, there was a systematic 
tendency for the seniors in 1980 to attempt more items than did the seniors of 
1972. The mc^t likely reason for this result was the change in 1980 from a 
separate answer sheet to an answer sheet as part of the test booklet. As 
described earlier, previous research has shown that a mechanical change of this 
nature can lead to a significant increase in the number of attempts. At any 
rate, IRT scoring can minimize the impact of such confounding soarces on test 
score variance, since the individual ability score, 8, is based only on items 
attempted. Therefore, the number of items attempted is controlled for n the 
estimation of 8. 

IRT methodology was used to put the 1972, 1980, and 1982 seniors on the same 
scale in vocabulary, math, and reading. This was accomplished by pooling samples 
from the 1972, 1980, and 1982 senior data and estimating the item and ability 
parameters (6) for the items and individuals. More specifically, items that were 
not present for a particular administration were treated as items not attempted 
for an individual at that administration. Thus a person's ability parameter, 8, 
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would be estimated from the common "core" items, (i.e., items common to all 
three administrations) and the items unique to his or her administration. 

The IRT parameters were estimated using the Logist computer program 
(Wood, R.L., Wingersky, M.S., & Lord. F.M., 1976). Computer runs were based 
on random samples of 2,000 individuals from each cohort, all of whom had 
attempted at least fifteen items. Once the item parameters were established 
for the tests based on the subsamples, Logist was applied to the full sample 
of 1972, 1980, and 1982 seniors to estimate the ability (8) of each individual 
in each cf the subject areas tested. Since a person's ability estimate, 8, 
was based on only those items attempted, individuals who attempted only the 
first three or four items and got them all correct would have a grossly 
overestimated 8. Plots of observed formula scores against 8 were inspected 
for those individuals who attempted 1 through 10 items. Only a handful of 
examiness had 8's inconsistent with their observed formula scores. No 8's 
were estimated for these individuals. Using the 8's and the item parameters 
from the 1972 senior tests (vocabulary, reading and math), the probability of 
passing each of the 1972 test items in each of the subject areas was estimated 
for each individual, regfdless of his or her cohort. The sum cf these 
probabilities is an individual's number right true score (NRTS). In this 
fashion, we can estimate the NRTS on the 1972 items for any individual from 
the 1980 or 1982 senior population. 

In a sense we are asking how would individuals from the 1980 and 1982 
senior cohorts score if they had taken the 1972 items. This makes possible 
the desired cross-sectional comparison of scores across senior cohorts. Having 
estimated NRTS for all senior cohorts as if they had taken the 1972 test 
items, the scores were then transformed tr a formula scored scale using a 
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simple algorithm* This transformation puts the "formula scored number right 
true scores" on * scale similar to the formula scored observed scores* 
In addition to estimating NRTS for the 1972 test items. NRTS were 
estimated for each individual on his own set of tests* For the longitudinal 
IRT scaling, item parameters were calibrated separately for sophomores and 
seniors and then transformed to the senior scale* Tests that were present in 
1982 but not in 1972 or 1980 were treated somewhat differently because of 
their relatively short length from an IRT perspective* For the science and 
writing tests, the full samples of approximately 24,000 sophomores and 25,000 
seniors were used in the item calibration runs instead of sub samples, since 
additional observations can help to overcome possible instability of estimates 
caused by small numbers of items* Because of its very «hort length (10 items) 
and its diversity of subject material, the civics test was considered 
inappropriate for IRT scaling* The IRT parameters are presented in Appendix 
F. 

Cross-Sectional Comparisons of Test Score Change 

Figures 5*10 present "box and whisker" plots of vocabulary performance 
for the three administrations to seniors and the one to sophomores. Figure 5 
shows the total group, and Figures 6-10 show senior and sophomore vocabulary 
performance by sex and ethnic groups* It should be kept in mind that all 
these cross-sectional comparlslons are based on estimated formula corrected 
number right true scores on the 1972 test items* The results are based on the 
data and Included every sampled senior who was still in school and sophomores 
who remained in school at least until the senior testing* 

The box and whisker plots show the 10th and 90th percentile (the ends of 
the whiskers) and the 25th and 75th percentile (the lower and upper end of the 
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boxes), and the means and medians. The medians are shown in parentheses. 
Inspection of the vocabulary results for the total sample suggest that while 
there is a senior vocabulary mean performance decline from 1972 to 1980, it 
levels off between 1980 and 1982. An indication of the possible impact of the 
educational treatment on increasing the diversity of performance can be shown by 
the comparison of the sophomore-senior variances. 

When the total population is split into sex groups, Figures 6 and 7, there 
is little differential change by sex groups in means when the 1980 and 1982 
senior cohorts are compared. Figures 6 and 7 do show that 1972 to 1980 decline 
was less for males than for females (.4 versus .9). 

Inspection of the results for the white, black, and hispanic populations, 
Figures 8-10, show that while there is virtually no decline for blacks and 
hispanics between 1972 and 1980, whites show significant declines. The white 
vocabulary mean increases from 1980 seniors to 1982 seniors while both the 
blacks and hispanics decline during this two-year period. These 1980 to 1982 
senior results would be consistent with a hypothesis that a larger proportion of 
those blacks and hispanics who in the past tended to drop out of school are now 
staying in school, (possibly because of the Implementation of special programs). 

Reading scores (Figures 11-16) in the total senior populations show 
substantial declines from 1972-1980-1982. Although the "box and whisker" plots 
do not show any greater diversity in reading ability when going from 1980 to 
1982 seniors there is a noticeable "bulge" of low-reading ability people as 
indicated by the short whisker in 1982. Inspection of the sex groups and the 
ethnic groups suggest that the decline is relatively consistent across all 
groups. Inspection of the box and whisker plots for blacks suggest that a 
decrease in diversity or variance as well as in means is occurring. 



READING: TOTAL GROUP 



R 
T 

S 

c 

0 
R 
E 




1 1 r 

NLS SENIORS I HSB 1980 SOPHS. 

HSB 1988 SENIORS HSB 1982 SENIORS 



117 



ERJC 



READING: FEMALES 



I 
R 
T 

S 

c 

0 
R 
E 




1 r — T 

NLS SENIORS I HSB 1988 SOPHS. 

HSB 1988 SENIORS HSB 1982 SENIORS 



Pi <5 

« • 



8 



113 
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READING : BLACKS 
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The Mtheutics scores (Figures 17-22) show • consistent decline for 
totl senior, fro. 1972 to 1980 to 1982. When you look et the sex groups, the 
decline for seniors fro. 1972 to 1980 to 1982 is there in both sex groups. 
Inspection of the ethnic group results show declines for all groups with 
hispanics characterised by slightly greater declines. 
Longitudi nal Changes in Test Scores 

Tcble 20 presents the nunber of observations used to calculate the IRT 
test score statistics by subpopulations. It should be noted that the smallest 
subpopulation, black sale sophomores, had more than 1,200 cases. Table 21 
presents a conparison of vocabulary test score ststistics for sophomore and 
senior totals and by subpopulations. The entries in the last colunn of Table 
21 under the label -gain" are siaply the differences between the iseans 
fX (SEN)-X (SOPH)) divided by the sophomore stsndard deviation. With the 
exception of hispanics, all ethnic and sex groups show average gains in 
vocsbulsry somewhat over a third of a standard devistion. It is also 
interesting to note thst the Vocabulary score gsp between whites and blacks 
end whites and hispanics increases as one goes fro. the sophomore to senior 
year. We would expect this increasing knowledge gsp to be at least in part 
due to possible curriculum differences. Another interesting finding is that, 
with the exception of black f assies, the vocsbulsry gsp between males and 
ferules is reduced ss one moves fro. sophomore to senior ststus. Once agsin, 
this differential gain may reflect differences in curriculum choices. 

Table 22 presents the results on performance changes in reading. 
Similar to the results in vocabulary, the gap in reading skills between whites 
and the other two ethnic groups shows an increase over the two additional 
years of schooling. However, unlike the vocabulary area, there is no 
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MATHEMATICS: MALES 
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Table 20 



NUMBER OF CASFS USED TO CALCULATF 
IRT SCORE STATISTICS fW SOPHOMORE COHORT TESTS 



MSB 1980 SOPHOMORFS MSB 1982 SENIORS 





VOCABULARY 


READING 


MATH 


SCIFNCF 


VOCABULARY 


REA0IN6 


MATH 


SCIENC1 


TOTAL 6RL1IP 


22 111 3 


22770 


22770 


22566 


2*09* 


73887 


23700 


23387 


MALE 


11086 


1106* 


11065 


10975 


11828 


11722 


• •AAA 

1 16*8 


11911 


FEMALE 


11727 


11706 


11705 


11591 


12266 


12165 


12052 


11876 


WHITE 


15680 


156*7 


H635 


155*0 


16108 


15960 


15857 


15666 


BLACK 


2TT2 


2773 


2775 


2708 


3121 


310t 


3066 


3016 


HISPANIC 


3730 


3721 


3735 


3698 


*180 


*l*5 


♦ 101 


*0*3 


WHITE MALE 


7671 


7656 


7653 


7611 


7910 


7836 


7796 


7713 


WHITE FEMALE 


8009 


7991 


7982 


7929 


1198 


812* 


8061 


7933 


BUCK MALE 


1231 


1231 


1232 


120* 


1*33 


!*23 


1*02 


1380 


BLACK FEMALE 


19*1 


15*? 


15*3 


150* 


1688 


1678 


166* 


1636 


HISPANIC MALE 


1865 


1859 


1863 


18*7 


2136 


2116 


210* 


2076 


HISPANIC FEMALE 


1865 


1862 


1872 


1851 


20** 


2029 


19«7 


1969 



NOTEj HSR 1980 SOPHORORES WHO HAD OROPPED OUT HP SCHOOL THE TIKE OP THE I9i? FOUOWP STATUS 

DETERMINATION MERE FXCLUOEO PROM BOTH RASE YFAR AND FOLLOWUP TFST STATISTICS. 
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Table 21 , 

IRT SCOKF STATISTICS ON SOPHOMORF COHORT TESTS 
VOCABULARY 



HSB 1980 SOPHOMORES 



HSR 1982 SFNIORS 





MEAN 


S.D. 


SKFW- 
NESS 


KURT- 
OS IS 


MEAN 


S.D. 


SKEW- 
NESS 


KURT— 
OSIS 


GAIN 
tIN S.I 
UNITS 


TOTAL GROUP 


8.9 


5.2 


0.0 


-0.8 


10.9 


5.6 


-0.2 


-0.8 


0.38 


MALE 


9.1 


5.1 


0.0 


-0.8 


10.9 


5.5 


-0.2 


-0.8 


0.36 


FEMALE 


8.8 


5.3 


0.1 


-0.8 


lo. n 


5.7 


-0.2 


-0.9 


0.40 


WHITE 


10.1 


4.8 


-0.1 


-0.6 


1?«2 


5.0 


-0.4 


-0.5 


0.43 


BLACK 


4.9 


4.5 


0.8 


0.1 


6.7 


5.2 


0.4 


-0.6 


0.39 


HISPANIC 


9.8 


4.7 


O.S 


-0.4 


7.2 


5.4 


0.4 


-0.7 


0.31 


WHITE MALE 


10.2 


4.T 


-0.1 


-0.6 


12.? 


5.0 


-0.4 


-0.5 


0.41 


WHITE FEMALE 


10.0 


4,9 


-0.0 


-0.7 


12.2 


5.1 


-0.4 


-0.5 


0.43 


BLACK MALE 


5.5 


4.5 


0.7 


0.2 


7.3 


5.2 


0.4 


-0.7 


0.40 


BLACK FEMALE 


4.4 


4.5 


t.O 


0.5 


6.2 


5.1 


0.6 


-0.4 


0.39 


HISPANIC MALF 


6.0 


4.6 


0.5 


-0.4 


7.3 


5.3 


0.4 


-0.8 


0.27 


HISPANIC FEMALE 


5.4 


4.7 


0.6 


-0.5 


7.1 


5.5 


0.4 


-0.7 


0.36 



NOTE Si U IRT SCORES HAVF BFEN ESTIMATED ON THE TEST ITEMS ACTUAl LY ADMINISTEREO TO THE 
SOPHOMORE COHORT. 
2) STATISTICS ARE BASED ON WEIGHTED DATA. 

31 HSB 1980 SOPHOMORES WHO HAD DROPPED OUT OF SCHOOL BY THF TIME OF THE 1982 FOLIOWUP 
STATUS DETERMINATION WFRF EXCLUDED FROM ROTH MSF YEAR AND FOLLOWUP TFST STATISTICS. 
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systematic difference in the rate of gain for males end females. 

Table 23 presents the results on changes in mathematics performance over 
the last two years of high school. The gap in mathematics periormance 
between whites and other two ethnic groups continues to widen in terms of 
raw score points, if not in terms of standard deviation units. Similarly, the 
gap between males and females also shows a slight increase as one goes from 
sophomore to senior status. This increase in the gap between male-female math 
performance is not present for hispanic males and females. In fact, 
regardless of the achievement area, hispanic women show bigger gains in their 
last two years of high school than do their male counterparts. 

Table 24 presents gains in the science area for totals as well as 
subpopulations. Similar to previous achievement areas, the white students 
show greater gains than do their minority counterparts. There is little 
difference between males and females with respect to relative gains with the 
exception (once again) of hispanic females. Hispanic females show a slight 
increase compared with hispanic males in raw score points and a somewhat 
greater increase in terms of standard deviativn units. 

When taking into consideration all four achievement areas, one would 
conclude: 

1. The biggest gains over the two year schooling period were in vocabulary 
and reading. Gains in math and science were considerably smaller on 
average. On might wonder why the biggest gains occurred in an 
achievement area that would seem at first glance less curriculum- 
relevant. However, reading and vocabulary are central to achievement in 
all curriculum areas. Regardless of what curriculum one selects, one 
will have to practice his/her reading and vocabulary skills. 
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Table 22 

IRT SCORE STATISTICS ON SOPHOMORE COHORT TFSTS 
RFAOING 



HSB 1980 SOPHOMORES H$8 I9R2 SENIORS 









MEAN 


S. 


SKEW- 
»D. NESS 


KURT- 

nsis 


MEAN 


S.D. 


SKEW- 
NESS 


KURT- 
OS I S 


GAIN 

tin s.t 

UNITS) 


TOTAL GROUP 






7.0 


4 


.7 0.3 


-0.7 


8.2 


5.0 


0.1 


-0.9 


0.29 


MALE 






7.1 


4 


.8 0*2 


-0.7 


8.3 


5.1 


0.1 


-0.9 


0.29 


PENAL E 






7.0 


4, 


• 7 0.3 


-0.6 


8.1 


9.0 


0.2 


-0.9 


0.29 


WHITE 






7.9 


4, 


.6 0.1 


-0.7 


9.2 


4.9 


-0.0 


-0.8 


0.27 


•LACK 






4.4 


4, 


.0 0.8 


0.3 


5.4 


4.2 


0.7 


0.0 


0.24 


HISPANIC 






4.3 


4, 


• 1 0.8 


0.4 


5.4 


4.9 


0.7 


-0.1 


0.29 


WHITE MALE 






8.0 


4. 


.7 0.1 


-0.7 


9.3 


9.0 


-0.1 


-0.8 


0.27 


WHITE FEMALE 






7.8 


4. 


,A 0.2 


-0.7 


9.1 


4.9 


0.0 


-0.9 


0.27 


BLACK HALE 






4.5 


4. 


il 0.8 


0.3 


5.8 


4.3 


0.9 


-0.3 


0.30 


•LACK FEMALE 






4.3 


3. 


,9 0.8 


0.3 


5.0 


4.0 


0.8 


0.4 


0.19 


HISPANIC MALE 






4.4 


4. 


2 0.7 


0.1 


5.4 


4.6 


0.7 


-0.2 


0.22 


HISPANIC FEMALE 


» 


4.2 


3. 


8 0.9 


0.7 


*•<; 


4.4 


0.7 


0.0 


0.30 


NOTES l 11 IRT 


SCORES 


HAVE 


BEEN 


ESTINATEO 


ON THE TEST 


ITEMS 


ACTUALLY 


AOMINISTEREO TO 


THE 



SOPHOMORE COHORT. 
21 STATISTICS A<E 6ASE0 ON WFIGHTEO OATA. 

31 HSB 1990 SOPHOMORES WHO HAO OROPPFO OUT OF SCHOOL BY THE TIME OF THE 1982 FOLLOWUP 
STATUS OFTFRMINATION WFPE FXCLUDFO FROM ROTH RASE 7FAR AND FOLLOWUP TEST STATISTICS. 
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Table 23 

IRT SCORE STATISTICS ON SOPHOMORE COHORT TESTS 
MATHEMATICS 



HSR 1980 SOPHOMORES 





MEAN 


S.O. 


SKEW* 
NESS 


KURT* 
OS IS 


TOTAL 6R0UR 


13.2 


9.T 


0.3 


-0.8 


NALE 




10.3 


0.3 


-0.9 


FEMALE 


12.11 


9.2 


0.2 


-0.8 


UNITE 


15.1 


9.5 


0.1 


-0.8 


BLACK 


6.4 


7.4 


1.0 


0.8 


HISPANIC 


7.6 


8.1 


0.8 


0.2 


WHITE HALE 


15.6 


10.0 


0.1 


-0.9 


WHITE PEN ALE 


u.r 


8.9 


0.1 


-0.7 


GLACR NALE 


6.3 


7.8 


1.1 


0.8 


SLACK FEMALE 


6.5 


7.1 


1.0 


0.7 


HlSPlNtC MALE 


7.9 


8.5 


0.8 


0.1 


HISPANIC PEMALE 


/•* 


7.6 


0.9 


0.3 



HSR 1982 SENIORS 



MEAN 


S.O. 


SKEW- 
NESS 


KURT- 
OS IS 


GAIN 
ITN S.( 

UNITS! 


14.6 


10.8 


0.2 


-1.0 


0.15 


11.2 


11.3 


0.2 


-1.0 


0.17 


U.l 


10.3 


0.2 


-0.9 


0.14 


16.6 


l').4 


0.0 


-0.9 


0.17 


7.6 


8.4 


0.9 


0.3 


0.17 


8.4 


9.3 


0.8 


-0.1 


0.10 


17.5 


10.9 


-0.0 


-1.0 


0.19 


16.1 


9.9 


0.0 


-0.9 


0.15 


8.0 


8.8 


0.9 


0.4 


0.21 


7.3 


8.0 


0.8 


0.1 


0.12 


8.6 


9.6 


0.8 


-0.1 


0.08 


8.1 


8.9 


0.8 


-0. 


0.13 



NOTES! II IRT SCORES HAVE REPN ESTIMATED ON THE TEST ITEMS ACTUALLY ADMINISTERED TO THE 
SOPHOMORP COHORT. 
21 STATISTICS ARE RASED ON WEIGHTED OATA. 

31 HSR 1980 SOPHOMORES WHO HAD DROPPED OUT OP SCHOOL RV THE TIME OP THE 1982 FOLLOWUP 
STATUS OPTtRMtNAT ION WPRF EXCLWFO FROM ROTH RASE TFAR AND FOLLOWJP TEST STATISTICS. 
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Table 24 

IRT SCORE STATISTICS ON SOPHOMORE COHORT TESTS 
SCIENCE 





HSB 


1980 


SOPHOMORES 




HSB 19B2 


SENIORS 


GAIN 
UN S.I 
UNITS 




MEAN 


s.n 


SKEW- 
. fit i > 


KURT- 
Ua I ? 


MEAN 


S.O. 


SKEW- 
NESS 


KURT- 
OSIS 


TOTAL GROUP 


9.1 


4.5 


-0.1 


-0.6 


9.9 


4.6 


-0.2 


-0.6 


0.17 


MALE 


9.B 


4.6 


-0.3 


-0.5 


10.6 


4.7 


-0.4 


-0.5 


0.17 


FEMALE 


6.5 


4.3 


-0.1 


-0.6 


9.3 


4.4 


-0.1 


-0.7 


0.1B 


WHITE 


10.2 


4.1 


-0.2 


-0.3 


11.0 


4.2 


-0.4 


-0.3 


0.20 


BLACK 


5.4 


3.9 


0.6 


0.1 


6.1 


3.9 


0.6 


-0.1 


O.IB 


HISPANIC 


6.4 


4.2 


0.4 


-0.5 


7.0 


4.5 


0.2 


-0.7 


0.15 


WHITE MALE 


10.9 


4.1 


-0.4 


-0.2 


11.7 


4.2 


-0.5 


-0.0 


0.20 


WHITE FEMALE 


9.6 


3.9 


-0.2 


-0.4 


10.3 


4.0 


-0.3 


-0.4 


0.19 


BLACK MALE 


6.1 


4.2 


0.5 


-0.2 


6.9 


4.? 


0.4 


-0.5 


0.20 


BLACK FEMALE 


4.9 


3.5 


0.6 


0.2 


5.5 


3.6 


0.7 


0.2 


0.17 


HISPANIC MALE 


7.0 


4.4 


0.2 


-0.5 


7.4 


4.6 


0.1 


-0.7 


0.10 


HISPANIC FFMALE 


5.7 


3.9 


0.5 


-0.4 


6.6 


4.3 


0.3 


-0.6 


0.22 


NOTES* 11 IRT SCORES 
SOPHOMORE 


HAVF BEEN ESTIMATED 
COHORT. 


ON THE TEST 


ITEMS 


ACTUALLY 


ADMINISTERED TO 


THE 



, 21 STATISTICS ARF BASEO OM WFIGHTFO OATA. 
31 MSB 1980 SOPHOMORES WHO HAO OROPPEO OUT OF SCHOOL BY THF T IMF OF THF 1982 FOLLOWUP 
STATUS DETERMINATION MFRE EXCLUDED FROM BOTH BASE YEAR ANO FOLLOWUP TFST STATISTICS. 
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Conversely, improvement in science and mathematics skills, as measured 
by the HS&B tests, are much more likely to be affected by choice of 
curriculum than to act as a by-product of general schooling. 

2. Whites tended to show greater gains than did either of the other ethnic 
groups. This differential gain was more pronounced when whites were 
compared with hispanics. 

3. There was a consistent tendency for hlspanic women to show greater gains 
than hispanic men. This may reflect curriculum differences as well as a 
differential drop-out rate. That is, lower scoring hlspanic males may 
be laora likely to stay in school than are their female counterparts. 

A. There is a consistent tendency for the test score variance to increase 
as one goes from the sophomore to senior year. Thi6 increase is the 
normal expectation when an educational treatment is applied. 
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Initial Comparisons of IRT Scale Scores vith Observed Formula Scores 
The greatest potential benefit from IRT scaling is the ability to 
estimate how 1980 and 1982 seniors would score if they took the 1972 test 
battery* Unfortunately, one cannot compare the IRT results with, say, formula 
score results for the cross-sectional comparisons, since the observed formula 
score results would be unobtainable* Comparisons, however, can be made 
between formula scores and IRT scaled scores for the longitudinal sophomore- 
senior cohort* However, since in the longitudinal analysis, the same tests 
were administered to the same people on two occasions, the advantages of IRT 
scaling is less clear* In the case of mean changes, the IRT formula 
corrected scale score means for the total population will be identical to the 
raw formula scored means since the "true* score mean is equal to the observed 
mean* Slight differences between the observed means and the formula corrected 
number right true score (NETS) means might occur within some subgroups* 
However, these mean differences will be negligible* In theory the variance of 
NRTS should be somewhat less than the observed formula score variances* This 
follows, from the fact that the true score variance should be less than the 
observed formula score variance* At the same time, however, there is always 
an error in estimation of the NETS' s that may inflate the variance of the 
estimated NRTS's* The end result, with respect to the longitudinal data, is 
that NRTS and formula scored means are identical for sophomore and seniors, 
but the NRTS variances are generally equal to or slightly smaller than the 
observed formula scored variances* Thus, when one looks at mean changes in 
standard deviatior units, the difference in some cases will be larger for NRTS 
scores* 



1 A n 
A \* 
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Although NRTS would be expected to have little or no effect (from test 
theory assumption) on estimation of means, It was hoped that optimal item 
scoring weights might Increase the differentiation between Individuals 
(especially In the center of the distribution) and thereby Increase the 
correlation with external variables. The NRTS scores tend to pull In extreme 
scores but Increase the differentiation in the middle. Table 25 presents 
correlations between Individual IRT gains (1982 NRTS - 1980 NRTS) with base 
year NRTS scores, base year SES, and whether or not the individual was in the 
academic curriculum. The last three columns show the same analysis for 
observed formula scores. 

Table 25 suggests that the IRT scale scores lead to some improvement in 
the gain score correlations. With the exception of the writing test sophomore 
status, NRTS scores tend to have a less negative relationship with gains than 
do the observed formula scores. There is, however, almost no difference 
between the two scoring methods with respect to the correlation with SES and 
academic curriculum. 

Overall the psychometric analysis suggests that: 

• Differences in test administrations in 1972 and 1980, primarily a 
change in answer sheet format, lead to more items being attempted in 
1980 than in 1972. It is argued that item response theory being used 
here may substantially reduce the impact of any effects to this change 
in administration. 

• The test batteries app«».ar to be measuring the same things with the 
same precision across ethnic and sex group". Similarly, the 1980 
sophomore test batteries factor structure did not change when it was 
re-administered to the same sophomores two years later. The critical 

ERJC 14, 
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finding here is that we can be reasonably confident that any 
comparisons of test scores at two points in time are valid measures of 
change along the same dimension* 

The tests were at the appropriate difficulty level and the 1980 
sophomore cohort battery was sufficient so that gains could be a 
reasonable expectation. 



11' 
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Table 25 

Correlations of Test Score Gains (1980 to 1982) with Initial status , 

SES , and Academic Curriculum 





Raw 


Gain In 
Scores 


IRT 


Raw 




With 


With 




With 




Base 


Base 


With 


Base 




Year 


Year 


Academic 


Year 




Score 


SES 


Curriculum 


Score 


VOCABULARY 


-.18 


.05 


.05 


-.23 


READING 


-.28 


.04 


.05 


-.28 


MATH 


-.10 


.10 


.11 


-.14 


SCIENCE 


-.31 


.04 


.02 


-.34 


WRITING 


-.36 


.00 


-.01 


-.35 



Scores 



With 
Base 
Year 

SES 

.05 
.05 
.09 
.02 
.00 



With 

Academic 

C urric ulum 

.04 
.05 
.10 
.02 
.00 
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Summary 

Item analysis statistics vera computed for all tests in the 1972 and 1980 
senior, and 1980 sophomore and 1982 senior administrations. The purpose of 
the item analysis was to investigate whether (1) the tests were at the 
appropriate difficulty level f (2) the 1980 sophomore cohort battery had 
sufficient "ceiling" so that gains could be a reasonable expectation, and (3) 
the tests , with the possible exception of the civics test, had sufficient 
reliability to support reasonably accurate estimation of mean changes and 
changes in individual rank ordering over time. 

The results of the item analysis suggest that the tests were slightly 
more difficult than would be indicated by measurement theory. However, since 
the NLS and HS&B populations are characterised by considerable diversity in 
ability, one has to consider the tradeoff between having a test that may be on 
the easy side, and, as a result, suffer from possible ceiling effects for some 
subpopulations. The item analysis result J suggest a reasonable compromise was 
made. 

With respect to reliability, there is little in the way of changes in 
reliability or standard errors of measurement (SEM's) when comparing NLS 
1972 seniors with 1980 HS&B seniors. However, in the longitudinal comparison, 
there is a consistent gain in the reliabilities of the total test scores as 
one goes from the sophomore to senior year. 

Similar gains in reliability were found for all the subtests, with the 
exception of the biology subtest. It is suggested that future science score 
gains might be computed two ways— one with the biology items included and 
one with them excluded. 

Although the reliabilities were lower for blacks and hispanlcs when 
compared with whites, the standard errors of measurement were about the same, 
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suggesting the precision of measurement was about the same for all racial 
groups. 

Of the total test scores, only the civics test was of sufficiently low 
reliability to question its use in any individual change score analysis. The 
subtests for the most part are not sufficiently reliable to justify their use 
as measures of change in individual rank ordering. 

Confirmatory factor analysis was conducted to determine what the tests 
are and are not measuring; and whether what is being measured is the same 
across cohorts and selected subpopulations within cohorts. The factor 
analysis was carried out on rationally derived subtest "parcels- whose 
homogeneity was verified in the above reliability analysis. 

The factor analysis results suggested that there is little if any change 
in factor structure either cross-sectionally (i.e., when comparing 1972 and 
1980 senior cohorts), or in the longitudinal comparison of sophorores with 
seniors* With the exception of .he writing style, punctuation parcels, and 
the physics parcel, the remaining subtest parcels seen to possess little or no 
unique reliable variance beyond that which can be explained by a verbal and/or 
math factor. Black and hispanic factor structures are quite similar to white 
structures with the exception that performance on the science measures has a 
larger verbal component for hispanics than for whites. One somewhat 
surprising result is that there Is no increased differentiation between the 
verbal and math factors when going from sophomore to senior status (as 
measured by the factor Intercorrelation) . However, there is increased 
differentiation between Individuals (as measure 1 by increased test score 
variance) as the transition from sophomore to senior occurs. It is possible 
that additional achievement factors and factor differentiation would emerge if 
populations were defined by curriculum. Individuals in the academic 
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curriculum would be more likely to take additional specialized courses in 
areas of particular interest or skill. This should lead to more 
differentiation. In sum, there is little empirical evidence for the notion 
that the tests or test parcels measure different things for different ethnic 
or sex groups. 

Item Response Theory (IRT) was used to score tests within populations 
(1980-1982), and to score and equate tests across populations. IRT methods 
were used to put mathematics, vocabulary, and reading scores on the same scale 
for 1972, 1980, and 1982 seniors. Similarly, IRT methods were used to score 
all the HS&B tests given to individuals as Sophmores and repeated as seniors. 
The three parameter IRT model was selected over the one and two parameter 
models because of the possibility that guessing and/or speededness might be 
additional confounding sources of variance. The IRT analysis allowed one to 
compare how 1980 and 1982 seniors would score if they took the 1972 
vocabulary, reading, and mathematics tests. 

The results of the cross-sectional IRT equating suggest there is a 
continued decline in reading and mathematics scores from 1972, 1980, to 1982 
in both the total senior population and sex and race groups. Vocabulary 
scores declined from 1972 to 1980, but they seemed to level off between 
seniors in 1980 and 1982 in the total groups. Although the vocabulary decline 
appears to be arrested in the total group, both blacks and hispanics continue 
to show some decline between seniors in 1980 and 1982. 

The results of the sophomore-senior longitudinal test score gains 
analysis using IRT scales suggested: 

1. The biggest gains over the two-year schooling period were in vocabulary 
and reading. Gains in math and science were considerably smaller on 
average. One might wonder why the biggest gains occurred in an 

148 
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achievement area that would seem at first glance less curriculum- 
relevant than the others. However, reading and vocabulary are central 
:o achievement in all curriculum areas. Regardless of what curriculum 
one selects, one will have to use reading and vocabulary skills. 
Conversely, improvement in science and mat hematic skills, as measured 
by the HS&B tests, are much more likely to be affected by choice of 
curriculum than to a~t as a by-product of general schooling. 

2. Whites tended to show greater gains than did either of the other ethnic 
groups. This differential gain was more pronounced when whites were 
compared with hlspanics. 

3. There was a consistent tendency for hlspanic women to show greater 
gains than hlspanic men. This may reflect curriculum differences as 
well as a differential drop out rate. That is, lower scoring hlspanic 
males may be more likely to stay in school than are their female 
counterparts. 

4. There is a consistent tendency for the test score variance to increase 
as one goes from the sophomore to senior year. This increase is the 
normal expectation when an educational treatment is applied. 



ERLC 



140 



-120- 



References 

Anastasi, A. (1982). Psychological testing (5th ed.). New York: 
Macmillan. 

Angoff, W. H., & Schrader, W. B. (1984). Study of hypotheses basic to the 
use of rights and formula scores. Journal of Educational Measurement ,, 
21(1), 1-17. 

Borgatta, E. F., & Corsini, R. J. (1967). Quick Word Test . Itasca, IL: 

F. E. Research Publishers. 
Donlon, T. F. , Hilton, T. L. , & Schrader, W. B. (1978). Designing a test 

plan for the 1980 National Longitudinal Study "High School and Beyond" 

(prepared for the National Center for Education Statistics, Contract 

No. 300-78-0084). Princeton, NJ: Educational Testing Service. 
Earles, J. A. , Giuliano, T., Ree, M. J. , & Valentine, L. D. (1983). The 1980 

youth population: An investigation of speeded subtests . Brooks Air Force 

Base, TX: Air Fo::ce Human Resources Laboratory. 
Ekstrom, R. B., French, J. W. , & Harman, H. H. with Dermen, D. (1976). 

Manual for kit of factor-referenced cognitive tests, 1976 . Princeton , 

NJ: Educational Testing Service. 
Flanagan, J. C, Dailey, J. T., Shaycoft, M. F. , Gorham, W. A., Orr, D. B., & 

Goldberg, I. (1962). Design for a study of American youth . Boston: 

Houghton Mifflin. 

Flaus'her, R. L. (1971). Project Access research report number 3; Minority 

versus majority group performance on an aptitude test battery (ETS RB-71-48) . 
Princeton, NJ: Educational Testing Service. 

French, J. W. (1964). Experimental comparative prediction batteries ; 

High school and college level . Princeton, NJ: Educational Testing Service. 

ERIC 150 



-121- 

Heyns, B., & Hilton, T. L. (1982). The cognitive tests for High School and 

Beyond: An assessment. Sociology of Education 1982 , 55 , 89-102. 
Hilton, t. L., Schrader, w. b. , & Beaton, A. E. (1983). Responses to 

questions on military serv ice by 1980 high school seniors classified 

on ability and other variables (Final Report). Princeton, NJ: 

Educational Testing Service. 
Hilton, T. L. , & Schrader, W. B. (1980). Test analysis; High School and 

Beyond fi eld test , Princeton, NJ: Educational Testing Service. 
Hilton, T. L. , & Schrader, W. B. (1980). Alternative regression methods in 

data editing. Paper presented at the annual meeting of the American 

Educational Research Association, Boston. 
Hilton, T. L. • & Rhett, H. (1973). The base-year survey of the National 

Longitudinal Study of the High School Class of 1972 . (Final report 

to the U.S. Department of Health, Education, and Welfare, National 

Center for Educational Statistics, Contract No. OEC-0-7 2-0903 ) . 

Princeton, NJ: Educational Testing Service. 
Hilton, T. L. (1971). A technical proposal for a national longitudinal 

study of the high school class of 1972 . Princeton, NJ: Educational 

Testing Service. 

Horvitz, D. G., Mason, K. , Bayless, D., Jackson, D. , Hunt, N. , & Koch, G. 
(1972) • The design of a longitudinal survey of secondary school seniors . 
(Final Report, SU-610, prepared for National Center for Educational 

Statistics, U.S. Office of Education, under Contract No. OEC-0-71-0752.) 

Research Triangle Park, NC: Research Triangle Institute. 
Jensen, A. R. (1968). Social class, race, and genetics: Implications for 

education. American Educational Research Journal , 5, 1-42. 
Joreskog, K. G. , & Sorbom, D. (1983). LISREL VI, estimation of linear 

structural equat ion systems by maximum likelihood methods: a program . 

Chicago, IL: National Educational Resources. 



Lesser, G. S. f Fifer, G., & Clark, D. H. (1965). Mental abilities of 

children from different social-class and cultural groups. Monographs 

for the Society for Research in Child Development . 30(4). 
Lord, F. M. (1980). Applications of item response theory to practical 

testing problems * Hillsdale, NJ: Lawrence Erlbaum Associates. 
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test 

scores . Reading, MA: Addison- Wesley. 
Rohwer, W. D. , Jr., Linch, S., Levin, J. R., & Suzuki, N. (1958). Grade 

level, school strata and learning efficiency. Journal of Educational 

Psychology . 59(1), Part 1, 26-3i. 
Semler, !• J., & Iscoe, I. (1963). Comparative and developmental study of 

learning abilities of Negro and white children under four conditions* 

Journal of Educational Psychology . 54, 38*44* 
Stodolsky, S. S., 4 Lesser, G. (1967). Learning patterns in the 

disadvantaged. H arvard Educational Review . 37 . 546*593. 
Wood, R. L. t Wingersky, M. S., & Lord, F. M. (1976). LOGIST: A computer 

program for estimating examining ability and item characteristic curve 

parameters. Princeton, NJ: Educational Testing Service, Research 

Memorandum 76*6. 



Student Test Booklet 
Senior Test Booklet 
Sophomore Test Booklet 



APPENDIX A 



126- 



CENERAL DIRECTIONS 



This tMt has tlx sections. Some tactions have more than one pan. Durln the time 
allowed for each section or part, you aro to work only on it. The time limit for each 
section or separately timed pan is primed at the Spinning of each section or pan, 
and the supervisor will tell you when to begin and when to stop. If you finish a section 
or pen before time is called, go bade and check yc ir work on thar section or pan 
only. 

Your score on each section will be the number of correct answers minus a percentage 
of the number of incorrec: answers. Therefore, it will net be to your advantage to 
guess unless you are able to eliminate one or more of the answer choices. 

Marie all of your answers on the separate answer sheet, as no credit will be given for 
anything written in the test book. Make your marks on the answer sheet heavy and black, 
aa in the examples below. 

Sample Answers 

■ BBDG3E 

&] GO© BCD 



Be sure that the entire bent is blackenod. 

If you wish to change an answer, erase your first mark completely. 



CONTENTS OF TEST BOOK 



Section 1 


Vocabulary 


5 minutes 


Section 2 


Picture-Number 

(Two pans of S minutes each) 


10 minutes 


Section 3 


Reading 


15 minutes 


Section 4 


Letter Groups 


15 minutes 


Section 5 


Mathematics 


15 minutes 


Section 6 


Mosaic Comparisons 

(Three pans of 3 minutes each) 


9 minutes 


Total 




69 minutes 
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BsSjgii Each of flit ajuattlona balow oontltta of cat fori toUowtd by flwj wccda or pbraatt You art to atlaet aha 
ont word or phraat whoat moaning U doatat to that of tht word to capital laaara. 



Sawpte Qu aaQjoa jamplt Aaawtr 

aaLurs EUBBBJIII 

(A)taqr 
(I) Mm 

<©*? 

(D» 

(>) 



Id order • find da cornet nmt you look at dw word cMlly and An look tor a word below It dan ne the eeme or 
abneatttaaamaimnlag. Whn jroo do drto. jrou tn tfciTSw la the never becauee cold U eloant la meeaioa to dia 
wocd chuly 



section a 

BCnJRE-NUUBEK 



DtogctfpM! Tbia la a ttat of your ability tonmatnbar pictura-iumbar 
aacb part you will acudy a pag* of flftaan plcturta with nunbara. (tea 
ttttdda: 
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, Tba taction baa two pana. la 
i picturt-numbtr palrt will look 




Afttr studying tbt pagt ahowing both plcturta and 
• dlltaram order. 



. you wiU bt told to turn to a pagt ahowing tht plcturta la 



Oa your anawar abate tbt ra art tan boxes with mumbtrs abo»t tbtm for tach ojutatloo. Oat of tbt munbara will bt tbt 
number that goaa with tht picrurt. You art to bUckan tht box with that aumbar abovt It. 

U 24 II 44 H 57 63 73 77 « 

Examptaa: iQQQQQ 

15 27 34 41 46 55 42 75 12 If 

«•□□■□□ □□□□□ 

U U » M « H U (7 » £ 

»•□□□□■ □□□□□ 

Tht numbar that goaa with tbt picture of a ttlapbont la 7S, ao for txampla 1 you would blackan tht box with 73 abowj It. 
For txamplt 2 you would blackan tht box with 34 abovt It. For txampla 3 you would blackan tht box with 46 abort It. 



00 NOT TURN THIS FACE UNTIL YOU ARE TOLD TO 00 SO. 
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SECT10N 3 
READING 
Time— 15 iwlnittt 

Directions: Each passage Is followed by questions Used on Its content. Alter reeding s pessege, choose the best 
easwer to esch question end blacken the corresponding spsce on the answer sheet. Answer ell questions following 
outage on the beets of whet Is etsted or Implied in that pessege. 

(The items consisted of reading peessges of approximately 

XOO words followed by 3, 4, or 5 Items each of which had 
5 options) 

•19- A 



SECTION 4 
LETTER GROUfS 

Directions: Each question in this section consists of five groups of letters with 
four letters in each group. Pour of the groups have s characteristic tai common 
which the fifth group doss not have. Decide which group is different, snd blacken 
the space on the answer sheet that corresponds to the position (A, B, C, D, or E) 
of your choice). 

Wots: The common characteristic will not be besed on the sounds of groups of letters, 
the shapes of letters, or whether letter combinations form words or parts of words. 

Ssmpls Qiestlons Sample Answers 

1.0I00B 





A 


B 


C 


. D 


E 


1. 


NOPQ 


DEFL 


A BCD 


HQK 


uvwx 


2. 


NUX 


FLOC 


QUK 


TKDC 


VLOC 



lb sample question 1, the letters la four of the groups are In consecutive alpha- 
betical order, but group DEFL In column B is not; so spsce B hss been marked 
In the sample answers. In sample question 2, four of the groups contsln the 
letter L. Letter group THDC in column D is the group that Is different, so space D 
has been marked In the sample answers. 

You will have 15 minutes to work on tins section. 



DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO DO SO. 



-129- 



SECTION 5 
MATHEMATICS 

Directions: Each problem In this section consists of two quantities, one placed in Column A 
and one in Column B. You are to compare the two quantities and on the answer sheet blacken 
space 

A if the quantity in Column A is greater; 
B if the quantity in Column B is greater ; 
C if the two quantities are equal; 

D if the size relationship cannot be determined from the information given. 

Sample Questions Sample Answers 

Column A Column B 

Example 1. 20 per cent of 10 10 per cenr of 20 !• E ® H 0 

Example 2. 6x6 12 + 12 2. 



Answer C is marked in Example 1 since the quantity in Column A is ooual to the quantity in 
Column B. Answer A is marked for Example 2 since the quantity m column A is greater than 
the quantity in Column B. 

You will have 15 minutes to work on this section. 



DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO DO SO. 
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SECTION 6 
MOSAIC COMPARISONS 



Direcrkme: This tut consists of pairs of mottles, disc Is, patterns of s quarts like ttoot found on tiled 
floors or walla. Each mosaic la mada up of a number of partially abadad squares. Tba moaaica la aach 
pair are, Identical except tor one aquara which dtfltrs in shading, Tba venlcal cohamne of both moaaica 
art labalad A to C, A to D 9 or A to E according to tba mimbar of eobuns In tba mosaic. Your task will 
ba to locate, for aach pair of moaaica, tba column that contains tba singk aquare which la ahadad dif- 
ferently. Than mark tba apaoa on your aapar act answar ahaat that co r r es ponds to tba lettar at tba baad 
of that fffhimn, 

Sample Qutstioo Sample Anawar 




QBE 



In sample qutstioo l t tht right-hand tnd left-bud moaaica ara idantical except for die cantor square 
of column B t ao answer space B la blackened in tht eample answer. 



Sample Questions 



• ABC D A B C D 



Al CD 



3. 









V 




■ 


^rrk a 


A 


w 




■ 




A 


A 


k A^ 


■ 






A 




■ 


^ A± 


A 






1 


A^ A* 



Sample Answers 



In sample question 2, the bottom square in column D la die one that la different, ao answer space D 
la blackened in the sample answers. In sample question & the second square in column A la the one 
that la different, ao answer space A la blackened in the sample answers. 

There sre three pane to this test. All the moaaica in a single pan are the aame size. During the 
three minutes allowed for each part, you are to work on that pan only. Do not move ahead to the next 
pan until you are told to do ao. Remember only one aquare la different for each pair of moaaica. 



DO NOT TURN THIS PACE UNTIL YOU ARE TOLD TO DO SO. 
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SR/T 4278 
1980 



A-2 

(Note: examples are given only of 
Item types not used in the 1972 
test battery) 



SENIOR TEST BOOKLET 




High School and Beyond is sponsored by the National Center for Education Statistics, an agency of 
the United States Department of Education. 

There are several kinds of tests in this booklet Each test is timed and has its own instructions. You 
will be given time to read the instructions before you begin work on the test 

You've probably taken tests like these before, but this time no one in your school will see your test 
results. The important thing about these teste is that you will be representing thousands of other 
students like yourself. Your individual answers will be regarded as strictly confidential. They will 
be combined with answers from other students and will never be identified as yours. Your partici- 
pation is voluntary. 

STOP! DO NOT OPEN THIS BOOKLET 
UNTIL YOU ARE TOLD TO DO SO. 

STATE: 



SCHOOL NO: 



STUDENT NO: 



ERIC 



Prepared for £ National 
Center for Education 
Statistics by the 
Educational Testing Service 
NCES Form 2409-12 
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GENERAL DIRECTIONS 
12th Grade 

This test has seven sections, and two sections have two parts. During the time allowed for each section 
or part, you are to work only on it The time limit for each section or part is printed at the beginning 
of the section or part and the supervisor will tell you when to begin and when to stop. If you finish 
before time is called, go back and check your work on that section or part only. 

Your score on each section except Sections 6 and 7 will be the number of correct answers mtnuu a. 
percentage of the number of incorrect answers. Therefore, on Sections 1 through 5 It will not be to 
your advantage to guess unless you a*e able to eliminate one or more of the answer choices. 

Mark all of your answers by filling in the oval next to the appropriate answer. 

Use only the lead pencil you have been given. This kind of mark will work 

<5> <d ^ <j> 

Make heavy black marks inside the ovals. 

Be sure that the entire oval is blackened. These marks will NOT work: 

If you wish to change an answer, erase your first mark completely. 



CONTENTS OF TEST BOOK 



Section 1 


Vocabulary 






Part 1 


5 minutes 




Part 2 


4 minutes 


Section 2 


Reading 


15 minutes 


Section 3 


Mathematics 






Part 1 


15 minutes 




Part 2 


4 minutes 


Section 4 


Picture-Number 


5 minutes 


Section 5 


Mosaic Comparisons 






Part 1 


3 minutes 




Part 2 


8 minutes 


Section 6 


Visualisation in 
Three Dimensions 


9 minutes 


Section 7 


Questions About 
Testing 


5 minutes 
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SECTION 6 
VISUAUZATION IN THREE DIMENSIONS 
Time— 9 minutes 

Dbacdong Each problem nthb test hu a drawing of a flat piece of metal at the left. At the right are shown 
five objects, only one of which might be made by foldinff the flat piece of metal along the dotted Uoc You are 
to piek eat the eae of these five objects which shows Just iMwthepleceof flat inetaJwffl look when Hb folded 
at the dotted Haas. When ft b folded, no piece of metal overlaps any other piece, or b enclosed inside the 
object On thb test your •care will be the number of correct answers. 



Now bob at example 1 below. 




<D (D O (D • 




Of the five objects shown, only E could be made from the flat piece shown at iht left by folding It at eac 
of the dotted linos. E uowt how the flat piece would look after being folded. Therefore, oral E would U 
marked* 

Remember, all folds are Indicated by dotted lines; the solid lines show the cuts In the piece, and parts are 
not folded Inside of other parts of any objects (In other words, there Is no overlapping). 



DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO DO SO. 
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SECTION 7 
QUESTIONlS ABOUT THE TESTS 

Time— 5 minutes 

Now that you have completed the teste, we would appreciate your telling us how you felt about taking them. 
The Information you fill in wUl help us to understand better how tests should or should not be used in high 
schools. We would like to know your own views and reactions; your responses will not affect your test scores 
in any way and will be treated as confidential information. 



1. Today you have taken six teste that were intended to measure different abilities or areas of knowledge. 
These areas are: 

a. Vocabulary ± Picture-Number 

b. Reading e. Mosaic Comparisons 

c Mathematics I Visualisation in Three Dimensions 

How important do you think each of these six abilities will be to you in your own future? For each test in 
the list below, please mark oval A, B, C, or D. Make one mark for each test. 





Of little 


Fairly 


Very 


Don't 




importance 


important 


important 


know 


Vocabulary and Reading Tests 


<2> 


CD 


CD 


CD 


Mathematics Test 


CD 


CD 


CD 


CD 


Picture-Number. Mosaic Comparisons, and 








Visualization in Three Dimensions 


CD 


CD 


CD 


CD 



2. How concerned were you about doing very well on these teste? M ark one 

<S> Not concerned at all 

CD Only slightly concerned 

CD Somewhat concerned 

<E> Very concerned 



3. How much did you enjoy taking the teste? Mark one . 
CD Not at all 

® Only to a limited degree 
CD Somewhat 
CD A great deal 



4. On the whole, how well do you think your scores on the six i -,sts will show your real ability? Mark one . 

CD My real ability is prooably higher than my scores will show. 

CD My scores will probably be about right 

© My real ability is probably lower than my scores will show. 
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8- How did you feel while you were taking the tests? Please mark YES or NO after each word or phrase 



YES NO 

a. Calm O O... 

b. Interested in the tests O O... 

c Distracted by things going on in the room . . . O O. . . 

d. Afraid of not doing well O O... 

e. Bored O O. . . 

I Eager to do my very best O O... 

g. Angry or annoyed O O... 

It Under a lot of pressure O O... 

I Involved in taking the tests O O... 

j. Under a lot of strain to do well O O... 

k. Able to concentrate well on the test? O O... 

I. Uneasy O O... 

m. Uncomfortable O O. . . 

n. Distracted by noififs outside O O. . . 

a Confident in myself O O. . . 

p. Rather tired O O... 

q. Feeling that the tests don't matter nr. a . . . . O O. . . 

r. Often thinking about something else O O. . . 

s. Very tense O O... 

t Nervous or jittery O O. . . 



6. If you would like to add any comments or explain any of your answers to these questions about testing, 
please use the space below: 



SO/T 4278 , 
1980 ~ 1Jt> ~ 
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SOPHOMORE TEST BOOKLET 




High School and Beyond is sponsored by the National Center for Education Statistics, an agency of 
the United States Department of Education. 

There are several kinds of tests in this booklet Each test is timed and has its own instructions. You 
will be given time to read the instructions before you begin work on the test 

You've probably taken tests like these before, but this time no one in your school will see your test 
results. The important thing about these tests is that you will be representing thousands of other 
students like yourself. Your individual answers will be regarded as strictly confidential. They will 
be combined with answers from other students and will never he identified as yours. Your partici- 
pation is voluntary. 

STOP! DO NOT OPEN THIS BOOKLET 
UNTIL YOU ARE TOLD TO DO SO 

STATE: 
SCHOOL NO: o;>N 
STUDENT NO: 



Prepared for :he National 
Center for Education 
Statistics by the 
Educational Testing Service 
NCES Form 2409-11 
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GENERAL DIRECTIONS 
10th Grade 



This test has six sections, and one section has two parts. During the time allowed for each section or 
part, you are to work only on it The time limit for emch section or part is printed at the beginning of 
the section or part, and the supervisor will tell you when to begin and when to stop. If you finish a 
section or part before time is called, go back and check your work on that section or part only. 

Your score on each section will be the number of correct answers minus a percentage of the number 
of incorrect answers. Therefore, it will not be to your advantage to guess unless you an able to 
eliminate one 07 more of the answer choices. 

Answer each question by marking one of the answer ovals as no credit will be given for anything 
written elsewhere in the test book. 

Use only the lead pencil you have been given. This kind of mark will work: 

<j> <^ ^p <J) 

Make hcavj black marks inside the ovals. 
Be sure that the entire oval b blackened. 

These marks will NOT work: 
If you wish to change an answer, erase your first mark completely. O 



CONTENTS OF TEST BOOK 



Section 1 


Vocabulary 


7 minutes 


Section 2 


Reading 


15 minutes 


Section 3 


Mathematics 






Part 1 


16 minutes 




Part 2 


£ minutes 


Section 4 


Science 


10 minutes 


Section 6 


Writing 


10 minutes 


Section 6 


Civics 
Education 


5 minutes 



(Note: In the following pages, examples 
are given only of item types not used 
in the 1972 or* 1980 tests) 
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SECTION 4 
SCIENCE 
Time— 10 minutes 
20 Questions 

DIRECTIONS: Carefully read each question and any triatrial that relates to it Then, choose the best 
answer and blacken the corresponding oval 



(No sample was given. Actual items have five options.) 



DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO DO SO. 



SECTION 5 
WRITING 

Time— 10 minutes 
17 Questions 



Directions Carefully read each question and any material that relates to it Then, choose the best answer and 
blacken the corresponding oval. 



Sample Question 

For Example Question find the error in punctuation or capitalization. There is 
only one error. 

Example. All of the letterunafazines, anitxiewspapers on his desk were dated 

A B 

JuIyJ8^1969. 
C D 

The correct answer to this question is A because a comma should be placed tfter 
letters." 



ERLC 
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SECTION 6 
CIVICS EDUCATION 
Time— 5 imputes 
10 Questions 

Directions; Carefully read each question and any material that relates to U. Then, choose the best answer and 
blacken the corresponding oval 



(No example was given. Actual items have four options.) 



DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO DO SO. 
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APPENDIX B 
NLS Item Analysis Tables 



Bl 1972 Vocabulary Male-Female 

B2 1972 Vocabulary White-Black-Mspanic 

B3 1972 Vocabulary White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

B4 1972 Reading Male-Female 

BS 1972 Reading Whlte-Black-Hispanlc 

B6 1972 Reading White Male-White Female-Black Male- 
Black Female-Hispanic Ma3e-Hispanic Female 

B7 1972 Reading White Male-Whit*. Female-Black Male- 
Black Female-Hispanic Male-Hispar:ic Female 

B8 1972 Math Male-Female 

B9 1972 Math White-Black-Hispanic 

BIO 1972 Math White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

Bll 1972 Letter Groups Male-Female 

B12 1972 Letter Groups White-Black-Hispanic 

B13 1972 Letter Groups White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 



ERIC 



ICO 



-141- 
Bl 



item 1 

ITCH 2 

3 

i w 4 

ITEM 3 
ITCH 6 
ITEM 7 
ITEM S 
ITEM 9 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 1* 
ITEM 14 
ITEM 13 

MEAN 
S.O. 

SUMMARY s 

fcphula $ec*E 

• 8ICHT 
f WRCNG 

• CMITS 

• NOT AEACNEO 

COEFFICIENT ALPHA 
SAMPIE SUE 

POPULATION ESTIMATE 



KALE 



p* 


PBIS 


OELTA 




0.89 




8.1 


0.8? 


0.*5 


0.73 


13.5 


0.59 


0.7? 


0.79 


10.* 


0.80 


0.64 


0.71 


11.6 


0.62 


0.8* 


0. 70 


8.9 


0.83 


0.59 


0*52 


12.7 


0.5« 


0.5* 


0.74 


12.5 


0.60 


0.98 


0.62 


14.3 


0.77 


0.45 


0.60 


13.5 


0.48 


0. 90 


0.68 


13.0 


0.4* 


0.*? 


0.73 


13.7 


0.31 


0.97 


0.67 


U.4 


0.30 


0.91 


0.99 


14.9 


0.38 


a.37 


0.42 


14.3 


0.36 




0.69 


13.6 


0.53 


0.52 


0.64 


12.6 


0.54 


0.17 


0.11 


2.0 


0.18 



MEAN 
6.2 
7.6 
3.8 
1.0 
0.7 

0.78 

763" 
1264703 



S.D. 
4.2 
3.5 
3.3 
1.8 
1.7 



NLS 1972 
VCCABULA8V 

FEMAl E 



0.65 
0.75 
0. 75 
0.72 
0.69 
0.59 
0.75 
0.61 
0.58 
0.65 
0.67 
0.62 
0.5? 
0.40 
0.70 

0.64 
0.09 



TOTAL 



OELTA 


P + 


MIS 


OELTA 


6.1 


0. 99 


0.67 


8.1 


12.1 


0.5? 


0.74 


12.8 


9.7 


0. 76 


0.74 


10.2 


11.8 


0.63 


0.71 


11.7 


9.2 


0.84 


0.69 


9.1 


12.1 


0.5* 


0.56 


12.4 


12.0 


0.57 


0.74 


12.3 


14.3 


0.38 


0.61 


14.3 


13.2 


0.47 


0.59 


13.3 


13.6 


0.47 


0.66 


13.3 


14.9 


0.37 


0.69 


14.3 


15.2 


0.33 


0.64 


14.8 


14.2 


0.35 


0.46 


14.6 


14.4 


0.37 


0.41 


14*4 


12.7 


0.48 


0.66 


13.2 


12.5 


0.53 


0.64 


12.6 


2.1 


0.17 


0.10 


2.0 



MEAN 
6.5 
7.9 
3.7 
0.9 
0.5 

0.78 

773? 
1271806 



S.O. 
4.1 
3.3 
3.3 
1.7 
1.4 



MEAN 
4.3 
7.7 
3.7 
1.0 
0.6 

0.78 
15748 
2339029 



S.O. 
4.2 
3.5 
3.* 
1.7 
1.6 



9 
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B2 



Nts inn 
vocabuioy 







MITE 






BLACK 




HISPANIC 




TOTAL 






P* 


»8IS 








OELTA 


P* 


*B1S 


OELTA 


P* 


PAIS 


OELTA 


ITEM 1 


0.92 


0.45 


7.4 


0.73 


0.41 


10.5 


0.74 


0.42 


10.4 


0.89 


0.47 




ITEM 2 


0.55 


0.74 


12.5 


0.35 


0.44 


14.4 


0.34 


0.44 


14.4 


0. 52 


0.74 


12^8 


ITEM 3 


0.11 


0.72 


9.5 


0.49 


0.48 


13.1 


0.59 


0.43 


12.0 


0. 76 


0.74 


10.2 


ITEM 4 


0.67 


0.71 


11.2 


0.34 


0.54 


14.4 


0.47 


0.55 


13.3 


0.43 


0.71 


11.7 


ITEM 5 


O.M 


0.48 


4.4 


0.47 


0.40 


11.3 


0.41 


0.40 


11.9 


0.84 


0.44 




ITEM 6 


0.58 


0.55 


12.2 


0.42 


0.52 


13.8 


0.44 


0.45 


13.4 


0. 54 


0.54 


12^4 


ITEM T 


0.62 


0.79 


11.8 


0.34 


0.59 


14.7 


0.32 


0.41 


14.9 


0.57 


0.74 


12.3 


ITEM S 


0.41 


0.41 


13.9 


0.20 


0.44 


14.4 


0.20 


0.41 




0.38 


0.41 


14.3 


ITEM 9 


0.50 


0.59 


19.0 


0.24 


0«44 


15.4 


0.32 


0.46 


14.9 


0.47 


0.59 


13.3 


ITEM 10 


0.50 


0.44 


n.o 


0.27 


0.41 


15.5 


0.27 


0.52 


1 5. 5 


0.47 


0.44 


13.9 


ITEM U 


0.40 


0.49 


14.0 


0.18 


0.49 


14.4 


0.19 


0.44 


14. 5 


0.37 


0.69 


14.3 


ITEM 12 


0.35 


0.44 


14.5 


0.19 


0.40 


14.4 


0.17 


0.34 


14.8 


0.33 


0.44 


14.4 


ITEM 13 




0.47 


14.5 


0.27 


0.34 


15.5 


0.32 


0.33 


\ 4.9 


0.35 


0.44 


14.4 


ITEM 14 


o.jr 


0.42 


14.3 


0.28 


0.35 


15.4 


0.34 


0.4? 


14.4 


0.37 


0.41 


14.4 


ITEM 1$ 


0.52 


0.44 


12.8 


0.25 


0.57 


15.8 


0.33 


0.42 


14. 7 


0.48 


0.44 


19.2 


MEAN 


0.56 


0.49 


12.2 


0.35 


0.52 


14.4 


0.38 


0.52 


14.3 


0.53 


0.44 


12.4 


S.O. 


0.18 


0.09 


2.1 


9.16 


0.1*1 


1.8 


0.14 


0.10 




0.17 


0.10 




SUMMARY s 




























MEAN 


S.O. 


MEAN 


S.O. 


MEAN ! 


;.o. 


MEAN ! 


1.0. 


FCPMULA SCOPE 


6 


• 9 


4.0 


3 


•0 


3.2 


3 


•5 3 


\m 3 


4 


.3 < 




8 RIGHT 


8 


.2 


9.4 


4 


• 9 


2.7 


5 


• 4 2 


!• 8 


7 


.7 i 




1 WPONG 


5 


• 4 


9.2 


7 


• 8 


3.2 


7 


• 4 1 


1. 1 


5 


.7 ' 




* OMITS 


0 


.4 


1.7 


1 


•0 


1.9 


1 


»0 ) 


I. 8 


1 


• 0 ) 




1 NOT PEACHFD 


0 


• 5 


1.4 


1 


• 2 


2.3 


1 


• 0 \ 


!. 2 


0 


• 4 1 




COEFFICIENT ALPHA 




0. 74 




0.43 




0.42 






0.78 




SAMPLE SIZE 




11804 




1889 




474 






15748 




POPULATION ESTIMATE 2052080 




231532 




92233 




2559029 





IV 



NLS 1972 
VOCABULARY 



WHITE MALE WHITE FEMALE BLACK MALE BLACK FEMALE HISPANIC MALE HISPANIC FEMALE 



ITEM 1 


P* 


RBIS 


DELTA 


P* 


RBIS 


DELTA 


P* 


RBIS 


DELTA 


P* 


RBIS 


DELTA 


P* 


P9IS 


DELTA 


P* 


RBIS 


DELTA 


0.92 


0.67 


7.4 


0.92 


0.63 


7.4 


0.72 


0.62 


10.7 


0.75 


0.59 


10.3 


0. 75 


1.65 


10.3 


0.74 


0.60 


10.4 


ITEM 2 




v. • ~ 




V. O 7 




11*7 
111 f 




U. DO 


1 C 9 
1 5.2 


U. 3*9 


A Jk. C 

u. o 5 


1 %. 2 


A 111 

0.29 


A m\ m 
O. 67 


15.3 


m\ A. . 

0. 43 


m\ A. » 

0.63 


13.7 


ITEM 3 


0.77 


0.72 


10.0 


0.B5 


0. 74 


B.9 


0.44 


0.66 


13.6 


0.52 


0.70 


12.8 


0.56 


0.66 


12.4 


0.62 


0.61 


11. B 


ITEM 4 


0.69 


0. 71 


11.1 


0.66 


0.71 


11.4 


0.35 


0.54 


14.6 


0.37 


0.56 


14.3 


0.45 


0.49 


13.5 


0.49 


0.62 


13.1 


ITEM 5 


0.88 


0.68 


8.2 


0.87 


il.68 


B.5 


0. 66 


0.65 


11.3 


0.67 


0.56 


11.2 


0.65 


0.64 


11.5 


0.57 


0.58 


12.3 


ITEM 6 


0.55 


0.52 


12.5 


0.61 


0.59 


11.9 


0.39 


0.49 


14.1 


0.45 


0.55 


13.5 


0.40 


0.43 


14.0 


0.52 


0.46 


12.8 


ITEM 7 


0.59 


0. 74 


12.1 


0.65 


0.74 


11.4 


0.33 


0.55 


14.8 


0.34 


0.61 


14.7 


0.32 


0.67 


14.9 


0.31 


0.55 


14.9 


ITEM B 


0.40 


0.62 


14.0 


0.41 


0.60 


13.9 


0.21 


0.47 


16.2 


0.18 


0.46 


16.6 


0.19 


0.43 


16.5 


0.22 


0.37 


16.1 


ITEM 9 


0.48 


0.60 


13.2 


0.52 


0.57 


12.8 


0.25 


0. 39 


15.6 


0.26 


0. M 


15.5 


0.30 


0.47 


15.1 


0.34 


0.44 


14.6 


ITEM 10 


0.53 


0.66 


12.7 


0.47 


0.63 




0.30 


0.69 




0.24 


0.53 


1 C | 

1 t». n 


0.31 


0.55 


1 5.0 


0.23 


0.52 


16.0 


ITEM 11 


0.46 


0.72 


13.4 


0.34 


0.69 


14.7 


0.20 


0.61 


16.4 


0.18 


0.40 


16.7 


0.22 


0.60 


14.1 


0.17 


0.37 


16.9 


ITEM 12 


0.39 


0.67 


14.1 


0.31 


0.62 


14.9 


0.19 


0.41 


16.5 


0.18 


0.39 


16.6 


0.22 


0.41 


16.1 


0.14 


0.32 


17.4 


ITEM 1> 


0.32 


0.40 


14.9 


0.39 


0.54 


14.1 


0.76 


0.27 


15.5 


0.26 


0.41 


15.5 


0.30 


0.38 


15.1 


0.34 


0.27 


14.6 


ITEM 14 


0.38 


0.42 


14.2 


0.37 


0.41 


14.3 


0.27 


0.37 


15. v 


0.28 


0.33 


15.3 


0.32 


0.40 


14.9 


0.40 


0c40 


14.0 


ITEM 15 


0.^6 


0.64 


13.4 


0.57 


0.6B 


12.3 


0.23 


0.55 


15.9 


0.75 


0.5B 


15.7 


0.32 


0.66 


14.8 


0.34 


0.57 


14.7 


MEAN 


0.55 


0.63 


12.3 


0.57 


0.64 


12.1 


0.34 


0. 53 


14.7 


0.36 


0.52 


14.6 


0.37 


0.55 


14.4 


0.39 


0.49 


14.2 


S.O. 


0. IB 


0.10 


2.1 


0.19 


0.09 


2.2 


0.15 


0.12 


1.7 


0.17 


0.10 


1.9 


0.16 


0*11 


1.7 


0.17 


0.11 


1.9 


SUMMARY! 






































FORMULA SCOPE 


MEAN 


S.O. 


MEAN 


S.D. 


MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.D. 


MEAN S.D. 


6. 


7 


4.0 


7. 


1 


4.0 


2. 


8 


3.1 


3 


• 1 


3.2 


3. 


3 


3.4 


3. 


7 3.2 


* BIGHT 


8. 


1 


3.4 


8. 


4 


3.3 


4.7 


2.7 


5 


• 1 


2.7 


5. 


2 


2.9 


5. 


6 2.7 


f WRONG 


5. 


4 


3.2 


5. 


3 


3.2 


7. 


6 


3.2 


7 


.9 


3.2 


7. 


6 


3.3 


7. 


6 3.0 


# OMITS 


1. 


0 


1.7 


0. 


9 


1.6 


1. 


1 


1.9 


1 


• 0 


1.8 


1. 


0 


1.8 


1. 


0 1.9 


§ MOT BEACHED 


0. 


5 


1.5 


0. 


4 


1.2 


1. 


6 


2.6 


1 


•0 


2.0 


1. 


2 


2.4 


0. 


B I 


•9 


COEFFICIENT ALFHA 




0.76 






0.76 






0. 63 






0.63 




0.66 






0.99 




SAMPLE SIZE 




5887 






5835 






823 






1048 




339 






330 




POPULATION ESTIMATE 


1023734 




1015237 


102915 




126309 




4528B 






45BB3 





txf I 



173 



17 



2 



9 

ERIC 



144- 
B4 



NIS 19T2 
READING 









MAI E 






FEMALE 




TOTAL 


























?♦ 


MIS 


DELTA 




IMS 


DELTA 




PBIS 


DELTA 


ITEH 


1 


0.83 


0.66 




0.83 


0.63 




0.83 


0.65 


9.2 


ITE^ 


2 


0.74 


0.69 


10^4 


0.77 


0.62 


io!i 


0.75 


0.69 


10.3 


ITEM 


3 


0.85 


0.57 


8. 9 


0.89 


0.55 




0.87 


0.56 


8.5 


ITEM 




0.67 


0.64 


11.3 


0.72 


0.62 


I0I7 


0.69 


0.63 


11.0 


I TEN 


5 




0.59 


1 1 . 1 


0.73 


0. $9 


10.6 


0.71 


0. 59 


ir • 


ITEM 




0.81 


0.70 




0.75 


fl.67 


10.3 


0.78 


0.67 


9. 


ITEN 


7 


0.52 


0.60 


1 Z. 8 


0.48 


0.63 


13.2 


0.50 


0.61 


13.0 


ITEM 


8 


0.54 


0.66 


1 Z. 6 


0.59 


0.73 


12.1 


0.97 


0.69 


12.3 


ITEM 


9 


0.53 


0.59 


1 Z. 7 


0.57 


0.53 


12.3 


0.95 


0.55 


12.3 


ITEM 


Id 


•».54 


0.69 


1 Z. 6 


0.63 


0. 59 


11.7 


0.59 


0.99 


12.1 


ITEM 


11 


0.49 


0.54 




0.50 


0.55 


13.0 


0.49 


0.54 


l?.l 


ITF« 


12 


0.82 


O.fl 


9. 3 


0.84 


0.56 




0. 81 


0.99 


9.2 


ITEM 


19 


0.69 


0.69 


11.7 


O.Crl 


0.69 


1U9 


0.62 


0. 69 


11.8 


ITEM 


14 


0.35 


0.48 


14. 5 


0.30 


0.50 


15.1 


0.33 


0.49 


14.9 


ITEM 


15 


0.22 


0.44 


1 6. 1 


0.26 


0. 54 


15.5 


0.24 


0.49 


15.8 


ITEM 


16 


O.M 


0.59 




0.52 


0.61 


12.8 


0.52 


o.*o 


12.8 


ITEM 


11 


0.37 


0.39 


1 4. 4 


0.38 


0.40 


14.2 


0.37 


0.40 


14.3 


ITEM 


18 


0.75 


0.59 




0.71 


0.60 


10.8 


0.73 


0. 59 


10.6 


ITEM 


19 


0.43 


0.49 


13* 7 


0.44 


0.50 


13.6 


0.43 


0.49 


13.7 


ITEM 


20 


9.54 


O.M 


1Z. 0 


0.46 


0.58 


13.4 


0.50 


0.60 


13.0 


< 


UN 


0.59 


0.59 


12.0 


0.60 


0.58 


11.9 


0.59 


0.58 


11.9 


L.O. 


0.17 


0.08 




0.1*5 


0.07 




0.17 


0.07 


1.9 


SUMMA8Y* 






















i 


NEAN 


5.0. 


MEAN ! 


• D. 


MEAN ! 


i.O. 


FO»M(JlA SCORF 


9.5 


5.1 




■•8 ! 


'. 0 


9.7 




# P I GMT 


11.4 


4.2 


11.7 * 


1 


11.5 < 




• K^CNC 


7, 


.6 


3.9 




7.5 3 


*• 9 


7.6 1 




• C«ITS 


0.2 


0.6 


0.2 ( 


I. » 


0.2 1 




i NOT REACHED 


0 


.8 


1.9 


0.6 1 


. 6 


0.7 1 




COEFFICIENT *L*MA 




0.79 




0.79 






0.79 




SANPLE SIZE 




7639 




7732 






15748 




PDPUl ATI ON ESTIMATE 126*709 




1271806 




255902* 
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-145- 
B5 



ITFM 
IT EH 
ITEM 

i r fm 

I TEH 
ITFM 
ITEM 
ITEM 
ITEM 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITFM 1* 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM 18 
ITEM 19 
ITF" 20 



MEAN 
S.O. 

SUMHAPV: 



WH1TF 

P* P6IS OEl TA P* 



0.86 
O.Tfl 
0.R9 
0.72 
D. 73 
O.M 

0.61 
0. 59 
0.62 
0.53 
0.85 
0*66 
0.35 
0.25 
0.55 
0.3B 
0.76 
0.45 
0*53 

0*62 
O.lfl 



0.61 
0*66 
0.5? 
0.62 
0*56 
0.65 
0.58 
0.67 
0.52 
0*58 
0.52 
0*54 
0*66 
0.47 
0.52 
0.59 
0.39 
0.57 
0.51 
0.60 



8.7 
9.9 
8.0 
10.7 
10.5 
9.4 
12.6 
11.9 
12.1 
11.8 
12.7 
6. fl 
11.4 
1 4. 6 
15.7 
12.5 
U.2 
10.2 
13.5 
12.7 



0.57 11.6 
0.07 2.0 



FOPMULA SCOPE 
« RIGHT 
« WPCNG 

* CHITS 

* NCT PEACHED 

COEFFICIENT ALPHA 
SAMPLF SIZE 
POPUlATICN E STI MAT F 



MEAN 
10.* 
12.2 

7.1 

0.2 

0.5 

0.77 
1180* 
2052880 



S. 0. 
4.8 
3.9 
3.7 
3.6 
1.5 



NIS 1972 
PEAOING 

61 AC* 



0.70 
0.63 
0. 77 
0.60 
0.60 
0.58 
0.28 
0.31 
0.38 
0.43 
0.31 
0.71 
0.37 
0.20 
0.16 
0.33 
0.31 
0.51 
0.27 
0.29 

0.4* 
0.1* 



0.61 
0. 56 
0. 56 
0.66 
0.61 
0.62 
0.60 
0.61 
0.50 
0.56 
0.48 
0.60 
0.63 
0. 50 
0.23 
0. 56 
0.44 
0.49 
0.26 
0.34 

0.52 
0.12 



MEAN 
5.7 
8.1 
9.8 
0.2 
1.8 



S. 0. 

4.5 

3.7 

3.9 

0.7 

2.7 



HISPANIC 



TPTAl 



OEl T A 


P* 


PftIS 


OEITA 


P* 


P6IS 


10.9 


0.69 


0.65 


11.0 


0.83 


0.65 


11.7 


0.65 


0.63 


11.4 


0. 75 


0.6 r , 


10.1 


0.78 


0.53 


9.9 


0. t 7 


0.56 


11.9 


0.56 


0.61 


12.4 


0. 69 


0.6 3 


12.0 


0.56 


0.55 


12.4 


0.71 


0.59 


12.2 


0.62 


0.57 


11.8 


0. 78 


0.6 7 


15.4 


0.34 


0.59 


14.6 


0.50 


0.61 


14.9 


0.37 


0.63 


14.4 


0.57 


0.69 


U.3 


0.33 


0.64 


14.8 


0.55 


0.5* 


i?.7 


0.42 


0.56 


13.8 


0.59 


0.59 


14.9 


0.31 


0.48 


14.9 


0.49 


0.54 


10.8 


0. 73 


0.62 


10.6 


0.83 


0.59 


U.3 


0.41 


0.59 


13.9 


0.62 


0.69 


16.3 


0.21 


0.38 


16.3 


0.33 


0.49 


17.0 


0.18 


0.29 


16.6 


0. 24 


0.49 


U.7 


0.29 


0.53 


15.2 


0.52 


0.60 


15.0 


0.33 


0.32 


14.8 


0.37 


0.40 


12.9 


0.58 


0.50 


12.2 


0.73 


0.59 


15.4 


0.31 


0.35 


14.9 


0*43 


0.49 


15.2 


0.29 


0.44 


15.2 


0.50 


0.60 


I3u7 


0.45 


0.52 


13.6 


0.59 


0.58 


1.9 


0.18 


0.11 


1.9 


0.17 


0.07 



9.2 
10.3 

8.5 
11.0 
10.8 

9.9 
13.0 
12.3 
12.5 
12.1 
13.1 

9.2 
11.8 
14.8 
15.8 
12.8 
14.3 
10.6 
13.7 
13.0 

U.9 
1.9 



MEAN 
6.0 
8.5 

10.0 
0.2 
1.2 



S.O. 

4.6 

3.6 

3.9 

0.7 

2.3 



0.73 
1889 
231532 



0.73 

676 
92233 



MEAN 

9.7 
11.5 

7.6 

0.2 

0.7 

0. 79 
15748 
2559029 



S.O. 
5.1 
4.2 
3.9 
0.6 
1.8 



ERLC 
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MIS 1972 
RE AO INC 



WHITE HALE WHITE FEMALE BLACK HAL E BLACK FEMALE HISPANIC HALE HISPANIC FEMALE 





P* 


RBIS 


OFl TA 


P* 


P8IS 


OELTA 


P* PBIS 


OEl TA 


P* 


PBIS 


OELTA 


P* 


PBIS 


DELTA 


P* 


I 315 


net • m 

Oct TA 


ITEM 1 


0. 86 


O.o3 


8.7 


0.86 


0.60 


8.6 


CI* Aft 

V. DO 


v. 


11.1 


0.72 


0.57 


10.7 


0.71 


0.71 


a A m 

10.8 


A jl m 

0.67 


A jl A 

0. 60 


1 1*3 


ITEM 2 


0. 77 


0.67 


10.1 


0.7V 


0.64 


9.8 


0* AO 


0.64 


12*0 


0.65 


0.47 


11.4 


0.61 


A JL V 

0.67 


11.9 


0.70 


A jl A 

0. 60 


10.9 


ITEM 3 


0*87 


0.53 


8.4 


0.91 


0*50 


7. 5 


fl. 74 


0.58 


10.5 


0. 79 


0.54 


9.8 


0. 76 


C.53 


10.1 


A .A 

0 30 


A CC 

0. 55 


n JL 

9.6 


ITEM 4 


0*69 


0.63 


11.0 


0.74 


O.vl 


10.4 


0.55 


0.68 


12.5 


0.65 


0.62 


11.5 


0.57 


0.62 


12.3 


0.54 


A JLA 

0. 60 


14 JL 

12.6 


ITEM 5 


0.71 


0.56 


10.8 


0.75 


0.57 


10.3 


0.^5 


0.60 


12.5 


0.63 


0.61 


11.7 


0.52 


0.61 


12.8 


A K 0 

0.59 


0.51 


14 i 
12.1 


ITEM 6 


0.84 


0.66 


8.9 


tf.79 


0.65 


i.8 


i)~ao 


V. DO 


12.0 


0.56 


0.59 


12.4 


0.6'/ 


0.59 


11.6 


0c60 


0. 56 


12.0 


ITEM 7 


0.56 


0.56 


12.4 


0.52 


0.61 


12.8 


0.31 


0.63 


14.9 


0.25 


0.57 


15.7 


0.38 


0.62 


14.2 


0.30 


0.58 


15.1 


ITEM 8 


0.58 


0.64 


12.2 


0.65 


0.71 


11.5 


0. 32 


0. 59 


14.9 


0.31 


0.63 


15.0 


0.37 


0.63 


14.3 


0.36 


0.63 


14.4 


ITEM 9 


Om 56 


0.56 


12.3 


U.61 


0.49 


11.9 




v. w 


14.9 


0.43 


0.49 


13.7 


0.34 


0.62 


14.7 


0.32 


0.67 


14.8 


ITEM 10 


0.57 


0.58 


12.3 


0.67 


0.57 


11.3 


0.42 


0.64 


13.8 


0.43 


0.48 


13.7 


0.38 


0.50 


14.2 


0.46 


0.65 


13.4 


ITEM 11 


0.53 


0.52 


12.7 


0. 53 


0.52 


12.7 


0.3? 


0.48 


14.9 


0.31 


0. 50 


15.0 


0.30 


0.48 


15ol 


0.32 


0.50 


14.9 


ITEM 12 


0.85 


0*56 


8.9 


0.86 


0.51 


8.7 


0.68 


0.60 


11.1 


0. 73 


n.61 


10.5 


0. 72 


0.61 


10.7 


0.73 


0.64 


10.5 


ITEM 13 


0.67 


0.67 


11.3 


0.65 


0.66 


11.4 


0.39 


0.66 


14.1 


0.35 


0.60 


14.5 


0.43 


0.63 


13.7 


0.40 


0.56 


14.0 


ITEM 14 


0.37 


0.46 


14.3 


0.32 


0.48 


14.9 


o. 2: 


0 % 53 


16.2 


0.20 


0.47 


16.4 


0.25 


0.43 


13.7 


0. 16 


0.34 


16.9 


ITEM 15 


0.23 


0.47 


16.0 


0.28 


0.57 


H.3 


0.17 


0.19 


16.9 


0.16 


0.27 


17.1 


0.18 


0.35 


16.6 


0.19 


0.22 


16.6 


ITEM 16 


0.55 


0.57 


12.5 


0.5S 


0.61 


i*?.t> 


0.33 


0.59 


14.7 


0.34 


0.53 


14.7 


0.26 


0.50 


15.6 


0.31 


0.60 


15.0 


ITEM 17 


0.37 


0.39 


14.3 


0.39 


0.39 


14.1 


0.32 


0.49 


14.8 


0.30 


0.40 


15.1 


0.34 


0.35 


14.7 


0.31 


0.28 


15.0 


ITEM 18 


0.78 


U.*8 


10.0 


0.75 


0.57 


10.3 


0.54 


0.48 


12.6 


0.48 


0.50 


13.2 


0.64 


0.48 


11.6 


0.52 


0.54 


12.8 


ITEM 19 


0.45 


0. 50 


13.5 


0.46 


0. 52 


13.4 


0.25 


0.24 


15.7 


0.29 


0.32 


15.3 


0.3! 


0.43 


15.0 


0.31 


0.27 


14.9 


ITEM ?0 


0.57 


0.64 


12.3 


0.49 


U.58 


13.1 


0.33 


0.43 


!4.7 


0.25 


0.26 


15.7 


0.33 


0. 56 


14.8 


0.2% 


0.29 


15.6 


MEAN 


0.62 


0.57 


11.7 


0.63 


0.57 


11.5 


0.43 


0.54 


13.7 


0.44 


0. 50 


13.7 


0.45 


0.54 


13.5 


0.44 


0.51 


13.6 


S.O. 


0.18 


0.07 


2.0 


0.18 


0.07 


2.1 


0.1> 


0.13 


1.8 


0.19 


0.11 




0.17 


0.10 


1.9 


0.18 


0.14 


2.0 


SttfMAftVs 








































MEAN 


S. 0. 


MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.D. 


MEAN ! 


>. 0. 


r vO^UiA SCCPE 


10 


• 3 


4.8 


10.6 


4.7 


5 


.5 


4.7 


5 


.9 


4.2 


6. 


1 


4.0 


5 


.9 < 


*• 4 


H ?^MT 


12 


.1 


4.0 


12. 


4 


3.9 


7 


• 9 


3.9 


8*3 


3.5 


8. 


6 


3.9 


8 


• 4 1 


1. 6 


. i iG 


f. # 2 


3.7 


T.O 


3.7 


9 


.8 


4.1 


9 


.9 


3.8 


10. 


I 


3.9 


10 


.0 


I. 8 


* Cr-.ii TS 


0 


• 1 


0.6 


0.2 


0.7 


0 


.2 


0.6 


0 


• 3 


0.8 


0. 


2 


0.7 


0 


.2 < 


1.7 


* MOT * EACH ED 


0 


• 6 


1.7 


0.4 


1.3 


2 


.1 


3.0 


1 


• 6 


2.5 


1. 


1 


2.2 


1 


.4 4 


1.4 


COEFFICIENT ALPHA 




0.77 






0. r& 




0.76 






0. 70 






0.75 




0. 72 




SAMPLE SIZE 




5887 




5835 




823 






1048 




339 






330 




POPULATION ESTIMATE 1023734 


1015237 




102915 






126309 




45288 






45883 





ERJ.C 



NLS 1972 
READING 



WHITE MALE 



WHITE FEMALE 



BLACK MALE 



BLACK FEMALE 



HISPANIC HALE 



HISPANIC FEMALE 



P* RBIS 

ITEM 1 0.86 0.63 

ITEM 2 0*77 0.67 

!T£* 3 0.87 0.53 

ITEM 4 0.69 0*63 

ITEM 5 0.71 0.56 

ITEM 6 0.8* 0.66 

ITEM 7 0.56 0.56 

ITEM 8 0.56 0.6* 

ITEM 9 £1.56 0.56 

ITEM 10 0.57 0.58 

ITEM 11 0.53 0.52 

ITEM 12 0.65 C.56 

ITEM 13 0.67 0.67 

ITEM 14 0.37 0.46 

ITEM 15 0.23 0.47 

ITEM 16 0.55 0.57 

ITEM 17 0.37 0.^9 

ITEM 18 S.73 0.58 

ITEM IS 0.45 0.50 

ITEM 20 0.57 0.64 



MEAN 
S.O. 

SUMMARY: 

FORMULA SCTRE 

* RIGHT 
I WRONG 

* CM1TS 

I NOT REACHED 



0.62 0.57 
0.16 0.07 



OEITA 

8.7 
10.1 

8.4 
11.0 
10.6 

6.9 
12.4 
12.2 
12.3 
12.3 
12. 7 

8.9 
11.3 
14.3 
16.0 
12.5 
14.3 
10.0 
13.5 
12.3 

11.7 
2.0 



MEAN 
10.3 
12.1 
7.2 
0.1 
0.6 



S.D. 

4.8 

4.0 

3.7 

0.6 

1.7 



P* 
0.86 
0.7V 
0.91 
0.74 
0.75 
J. 79 
0.5? 
0.65 
0.61 
0.67 
0.53 
0.86 
0.65 
0.32 
0.28 
0.55 
0.39 
0.75 
0.46 
0.49 

0.63 
0.18 



RBIS 
0.60 
0.64 
0.50 
0.61 
0.57 
0.65 
0.61 
0.71 
0.49 
0.57 
0.52 
0.51 
0*66 
0.48 
0.57 
0.61 
0.39 
0.57 
0.52 
0.5R 

0.57 
0.07 



DELTA 
8.6 
9.8 
7.5 
10.4 
10.3 
9.8 
12.8 
11.5 
11.9 
11.3 
12.7 
8.7 
11.4 
14.9 
1^.3 
12.5 
14.1 

in.* 

13.4 
13.1 

11.5 
2.1 



COEFFICIENT AlPHA 0.77 
SAMPLE SIZE 5867 
POPULATION ESTIMATE 1023734 



MEAN 
10.6 
12.4 

7.0 

0.2 

0.4 

0.76 
5835 
1015237 



S.D. 
4.7 
3.9 
3. 7 
'1.7 
1.3 



P* 
0.68 
0.60 
0. 74 
0.55 
0.55 
0.60 
0.31 
0.32 
0.31 
0.42 
0.32 
0.68 
0.39 
0.21 
0.17 
0.33 
0.32 
0.54 
0.25 
0.33 

0.43 
0.17 



R8IS 
0.64 
0.64 
0.58 
0.68 
0.60 
0.66 
0.63 
0.59 
0.50 
0.64 
0.48 
0.60 
0.66 
0. 53 
0.19 
0.59 
0.49 
0.43 
0.24 
0.43 

0.54 
0.13 



DEI TA 

11.1 

12.0 

10.5 

12.5 

12.5 

12.0 

14.9 

14.9 

14.9 

13.8 

14.9 

11.1 

14.1 

16.2 

16.9 

14.7 

14.8 

12. o 

15.7 

14.7 

13.7 
1.8 



MEAN 
5.5 
7.9 
9.8 
0.2 
2.1 



S.D. 

4.7 

3.9 

4.1 

0.6 

3.0 



P* 
0.72 
0.65 
f|. ?1 
0.6S 
0.63 
0.56 
0.25 
0.31 
0.43 
0.43 
0.31 
0.73 
0.35 
0.20 
0.16 
0.34 
0.30 

0.29 
0.25 

0.44 
0.19 



RBIS 
0.57 
0.47 
0.54 
0.62 
0.61 
0. ->9 
0.57 
0.63 
0.49 
0.48 
0.50 
0.61 
0.60 
0.47 
0.27 
0.53 
0.40 
0.55 
0.32 
0.26 

0. 50 
0.11 



HfiAN 
5.9 

a. 3 

9.9 
0.3 
1.6 



OELTA 
10.7 
11.4 
9.8 
11.5 
11.7 
12.4 
15.7 
15.0 
13.7 
13.7 
15.0 
10.5 
14.5 
16.4 
17.1 
14.7 
15.1 
13.2 
15.3 
15.7 

13.7 
2.1 



S.D. 

4.2 

3.5 

3.6 

0.8 

2.5 



P* 
0.71 
0.61 
0.76 
0.57 
0.52 
0.64 
0.38 
0.37 
0.34 
0.38 
0.30 
0.72 
0.43 
0.25 
0.18 
0.26 
0.34 
0.64 
0.31 
0.33 

0.45 
0.17 



RBIS 
0. 71 
0.67 
0. 53 
0.62 
0.61 
0.59 
0.62 
0.63 
0.62 
0.50 
0.48 
0 51 
0.63 
0.43 
0.35 
0.50 
0.35 
0.48 
0.43 
0.56 

0.54 
0.10 



DELTA 

10.8 

11.9 

10.1 

12.3 

12.8 

11.6 

14.2 

14.3 

14.7 

14.2 

15.1 

10.7 

13.7 

15.7 

16.6 

15.6 

14.7 

11.6 

15.0 

14.8 

13.5 
1.9 



MEAN 
6.1 
8.6 

10.1 
0.2 
1.1 



S.D. 

4.8 

3.9 

3.9 

0.7 

2.2 



P* 
0.67 
0.70 
0.80 
0.54 
0.59 
0.60 
0.30 
0.36 
0.32 
0.46 
0.32 
0.73 
0.40 
0.16 
0.19 
0.31 
0.31 
0.52 
0.31 
0.2S 

0.44 
0.18 



RBIS 
0.60 
0.60 
0.55 
0.60 
0.51 
0. 56 
0.58 
0.63 
0.67 
0.65 
0.50 
0 64 
0.56 
0.34 
0.22 
0.60 
0.28 
0.54 
0.27 
0.29 

0.51 
0.14 



OELTA 
11.3 
10.9 
9.6 
12.6 
12.1 
12.0 
15.1 
14.4 
14.8 
13.4 
14.9 
10.5 
14.0 
16.4 
16.6 
15.51 
15.0 
12.8 
14.9 
15.6 

13.6 
2.0 



MEAN 
5.9 
8.4 

10.0 
0.2 
1.4 



S.O. 

4.4 

3.6 

3.8 

0.7 

2.4 



0.76 
823 
102915 



0. 70 
1048 
126309 



0.75 

339 
45288 



0.72 
330 
45883 



ERLC 



17G 



7 n 
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B8 



ITCH 1 
ITCH 2 
ITCH 3 
ITCH * 
1TFH 5 
ITCH 6 
ITCH 7 
ITCH 8 
ITCH 9 
1TC« 10 
ITCH li 
ITEH 12 
ITCH 13 
ITCH 1* 
ITEH 15 
ITF« 16 
ITEH 17 
ITCH I* 
ITFH 1* 
ITCH 20 
ITCH 21 
ITCH 22 
ITCH 23 
1TFM 2* 
ITFH 25 

HE AH 
S.D. 

SUNHAPVl 

FOPHUiA SCCPE 
f FIGHT 

• W»CNC 

• CHITS 

I NOT CACHED 



HAiE 



P* 


MIS 


DEITA 


0.84 


0.55 


9.0 


0. 79 


0.37 


9.8 


0.65 


0.59 


6.8 


0.8* 


0.51 


8.8 


0.73 


0. 80 


10.5 


0.81 


0.59 


9.5 


0.78 


0.71 


9.8 


0.65 


0.68 


11.5 


3.7* 


0.56 


10.5 


0.62 


0.72 


11.7 


0.64 


0.58 


11.6 


0. 75 


0."2 


10.3 


0.6* 


0. V 


11.4 


o.n 


0.53 


10.8 


0.60 


0.55 


12.0 


0.56 


0.T7 


12.4 


0.62 


0.72 


11.7 


0.60 


0.61 


12.0 


0.59 


0.52 


12.1 


0.62 


0. 75 


11.8 


0.51 


0.77 


12.° 


0.59 


0.6f 


12.5 


0.48 


0.65 


13.2 


0.52 


0.67 


12.8 


0.48 


0.64 


13.2 


0.66 


0.64 


11.2 


0.11 


0.10 


1.3 



NtS 1972 
HATH 

FEMAIE 

»♦ P8IS OEITA 

0.82 0.56 9*4 

0. 72 0.35 1 0.6 

0.82 0.52 9.4 

0.79 0.48 9.8 

0.69 0.77 11.0 

0.73 0.57 10.* 

0.74 0.61 10.4 

0.56 0*61 12.4 

0.74 3.57 10.5 

0.57 0.69 12.3 

0.54 0.62 12.6 

0.66 0.68 11.4 

0.63 0.72 11.7 

0.64 0.57 11.5 

0.53 0.53 12.7 

0.56 0.76 12.4 

0.59 0.63 12.0 

0.50 0.56 13.0 

0.52 0.47 12. « 

0.59 0.66 12.1 

0.47 0.76 13.3 

0.46 0.66 1 3.4 

0.38 0.60 14.2 

ft. 43 0.57 13.7 

0.46 0.49 13.4 

0.61 9.60 11.9 

0.12 P. 10 1.3 



TOT At 

P* P81S OEITA 

0.83 0.55 9.2 

0.76 0.36 10.2 

0.83 0.56 9.1 

0.82 0.50 9.3 

0.71 0.78 10.6 

0.77 0.59 tO.O 

0.76 0.66 1 0.2 

0.61 0.65 11.9 

0.74 0.56 10.5 

O.fO 0.70 12.0 

0.59 0.60 12.1 

0.70 0.70 10.9 

0.64 0.72 11.6 

0.68 0.96 11.2 

0.56 0.54 12.4 

0.56 0.76 12.4 

0.61 0.67 11.9 

0.55 0.59 12.5 

0.96 0.50 12.4 

0.61 0.72 11.9 

0.49 0.76 13.1 

0.90 0.66 13.0 

0.43 0.63 13.7 

0.47 0.63 13.3 

0.47 0.56 13.3 

0.63 0*62 11.6 

0.12 0.10 1.3 



HFAN S.D. 

13.6 7.4 

16.3 5.7 

8.0 5.4 

J.2 0.9 

0.5 1.8 



HE AN S.D. 

11.9 7.2 

14.9 5.6 

9.0 5.3 

0.5 1.4 

0.6 1.9 



HE AN S.O. 

12.7 7.3 

« 5.7 

6.5 5.4 

0.4 1.2 

0.6 1.9 



COEFFICIENT ALPHA 
SAHP1 F SI7F 
PCPUIATION EST I HAT F 



0.87 

76*99 
1264703 



0.85 

7732 
127? 806 



0.86 
1574» 
2559029 
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B9 



WHITE 



MS 1972 
MATH 

HACK 



HI SPANtC 



TCTM 



FBIS DFLTA FB1S DEITA ftftIS DEITA »6IS OflTA 



ITEM 1 0.66 

ITEM 2 0.77 

ITEM 3 0 .8f 

ITEM 4 0.85 

I Tf M 5 0.76 

ITEM 6 0.81 

ITEM 7 0.60 

ITFM 8 0.64 

ITFM 9 0.77 

ITEM 10 0.64 

ITEM U 0.63 

ITFM 12 o.?3 

ITF" 13 0.68 

ITC" 14 0.71 

ITEM 13 0.59 

lit* 16 0.60 

ITEM 17 0.€4 

ITEM 18 0,59 

ITEM 19 0.38 

ITEM 20 0.65 

IT** 21 0.53 

ITFM 22 0.54 

I*FM *3 0.46 

IT** 24 0.31 

ITEM 25 0.49 

MEAN 
S.D. 

SUMMARY t 

F08MW.A SCOPE 
f 81CHT 
f W»DN6 
f OMITS 
# NHT 8EACHE0 

COEFFICIENT Al PHA 0.85 
SAMPLE SIZE U804 
POPULATION ESTIMATE 2A52MO 



0.49 
0.35 
0.54 
0.48 
0.78 
0.58 
0.64 
O.f? 
0.54 
0.70 
0.58 
0.70 
0.70 
0.51 
0.55 
0.T6 
0.68 
0.57 
0.50 
0.70 
0.75 
0.65 
0.65 
0.61 
0.59 



8.6 
10.1 
8.6 
8.9 
10.2 
9.5 
9.6 
11.5 
10.1 
11.6 
11.7 
10.5 
11.1 
10.7 
12.0 
12.0 
11.6 
12.2 
12.2 
11.5 
12.7 
12.6 
13.4 
12.9 
13.1 



0.66 
0.68 
0.67 
0.€7 
0.47 
0.58 
0.55 
0.?9 
0.57 
0.38 
0.36 
0.54 
0.43 
0.41 
0.42 
0.32 
0.43 
0.36 
0.40 
0.35 
0.24 
0.25 
0.26 
0.27 
0.35 



0.57 
0.42 
0.38 
0.38 
C.66 
U35 
0.55 
0.56 
0.46 
0.54 
0.53 
0.61 
0.69 
0.54 
0. 39 
0.69 
0.54 
0.52 
0.41 
0.62 

o.n 

0.46 
0.31 
0.60 
0.24 



11.3 
11.1 
11.2 
11.2 
13.3 
12.2 
12.4 
14.2 
12.3 
14.2 
14.3 
12.6 
14.0 
13.9 
13.8 
14.9 
13.7 
14.4 
14.0 
14.5 
15.9 
15.7 
15.6 
15.5 
14.5 



0.65 
0.T3 
0. 73 
0.72 
0.51 
0.57 
0.56 
0.44 
0.60 
0.42 
0.42 
0.56 
0.47 
0.55 
0.38 
0.42 
0.40 
0.36 
0.45 
0.39 
0.35 
0.32 
0.27 
0.30 
0.37 



0.55 
0.39 
0.47 
0.42 
0.66 
0.45 
0.60 
0.5/ 
0.58 
0.63 
0.58 
0.6? 
0.64 
0.52 
0.36 
0.70 
0.60 
0.55 
0.38 
0.64 
0.63 
0.50 
0.42 
0.51 
0.92 



11.4 
10.6 
10.6 
10.6 
12.9 
12.3 
12.3 
13.6 
12.0 
13.8 
13.8 
12.4 
13.3 
12.* 
14.2 
13.8 
13.2 
14.4 
13.5 
14.1 
14.5 
14.9 
15.5 
15.1 
14.3 



0.83 
0.76 
0.83 
0.82 
0.71 
3.77 
0. 76 
0.61 
0.74 
0.60 
0.59 
0.70 
0.64 
0.68 
0.56 
0.56 
0.61 
0.55 
0.56 
0.61 
0.49 
0.50 
0.43 
0.47 
0.47 



0.55 
0.36 
0.56 
0.50 
0.78 
0.59 
0.66 
0.65 
0.56 
0.70 
0.60 
0.70 
0.72 
0.56 
0.54 
0.76 
0.67 
0.59 
0.50 
0.72 
0.76 
0.66 
0.63 
0.63 
0.56 



9.2 
10.2 
9.1 
9.3 
10.8 
10.0 
10.2 
11.9 
10.5 
12.8 
12.1 
10.9 
11.6 
11.2 
12.4 
12.4 
11.9 
12.5 
12.4 
11.9 
13.1 
13.0 
13.7 

13.; 

13.3 



0.67 0.61 


11.2 


0.44 0.51 


13.6 


0.48 0. 


53 


1?.2 


0.63 0.62 


11.6 


0.12 0.10 


1.4 


0.14 0.12 


1.4 


0.13 0. 


10 


1.4 


0.12 0.10 


1.3 


MEAN 


5.0. 


MF AN 


S.D. 


MEAN 




S.D. 


MEAN 


s.o. 


13.9 


7.0 


6.* 


6.0 


7.8 




4.5 


12.7 


7.3 


16.5 


5. 4 


1P.5 


4.7 


11.6 




5.0 


15.6 


5.7 


7.8 


5. 1 


12.3 


5.0 


11.7 




5.1 


8.5 


5.4 


0.3 


1.1 


0.6 


1.6 


0.5 




1.5 


0.4 


1.2 


0.4 


1.3 


1.7 


3.1 


1.1 




2.7 


0.6 


1.9 



0.77 
1889 
231532 



0.80 
676 
92233 



0.86 

15748 
2559029 



ERLC 



NLS 1972 
MATH 







WHITE MALE 


WHITE FEMALE 


BLACK MALE 


BLACK FEMALE 


HISPANIC MALE 


HISPANIC FEM'iE 






P* 


RBIS 


OELTA 


P* 


R8IS 


OELTA 


P* 


RBIS 


OELTA 


P* 


RBIS 


OELTA 


P* 


RBIS 


OELTA 


P* 


RBIS 


OELTA 


ITEM 


1 


0.87 


0.49 


8.4 


0.85 


0.49 


8.8 


0.68 


0.56 


11.1 


0.65 


0. K 7 


11.5 


0.68 


0.54 


11. 1 


0.63 


0.56 


11.7 


ITEM 


2 


0*80 


0.34 


9.6 


0.73 


0.34 


10.5 


0. 71 


0.45 


10.8 


0.66 


0.39 


11.4 


0. 76 


0.36 


10.1 


0.69 


0.41 


11.1 


ITEM 


3 


0*88 


0.56 


6.2 


0.84 


0.51 


8*9 


0.66 


0. 44 


11.4 


0.69 


0.33 


11.1 


0. 73 


0.51 


10.6 


0. 73 


0.43 


10.5 


ITEM 


4 


«!• P7 


0.49 


8.4 


0.82 


0.47 


9.3 


0. 71 


0.45 


10.8 


0.64 


0.33 


11.5 


0. 75 


0.38 


10.2 


0.70 


0.45 


11.0 


ITEM 


5 


0.77 


0.82 


10.0 


0.74 


0.75 


10. 5 


0. 50 


0.63 


13.0 


0.45 


0.69 


13.5 


0.58 


0.63 


12.2 


0.44 


0.70 


13.6 


ITEM 


6 


0. 84 


0.58 


9.0 


0.78 


0.58 


10.0 


0.62 


0.44 


11.8 


0.55 


0.25 


12.5 


0. 64 


0.44 


11.6 


0.51 


0. 44 


12.9 


ITEM 


7 


O.BZ 


0.74 


9.3 


l). 78 


0.59 


9. 9 


0. 56 


0.63 


12.4 


0.55 


0. 48 


12. 5 


0.61 


0.60 


11.9 


0. 52 


0.59 


12.6 


ITCH 


8 


0*69 


0.67 


11.1 


0.60 


0.59 


12.0 


0.39 


0.58 


14.1 


0.38 


0. 54 


14.2 


0.49 


0.60 


13.1 


9.39 


0.42 


14. 1 


ITEM 


9 


0* 77 


0.54 


10. 1 


0. 77 


0.55 


10.0 


0.57 


0.48 


12.3 


0. 58 


0.48 


12.2 


0. 58 


0.63 


1 2. 2 


0. 63 


0. 56 


11.7 


ITE« 


10 


0.66 


0 • 72 


11.3 


0.61 


0.68 


11.9 


0. 42 


0. 56 


13. 8 


0.35 


0. 52 


14. 6 


0. 44 


0.66 


13.6 


0.40 


0.62 


14.0 


ITE* 


11 


0* 67 


0. 56 


11.2 


0. 59 


0.60 


12.1 


0.42 


0. 55 


13.8 


0.30 


0.49 


15. 1 


0.48 


0. 57 


13.2 


0.?7 


0. 57 


14. 3 


!TEM 


12 


0. 78 


0. 72 


9.9 


0.69 


0.68 


11. 1 


0. 57 


0.59 


12.3 


0. 51 


0. 62 


12. 


0. 61 


0.68 


11.9 


0. 52 


0. 55 


12.8 


ITEM 


13 


0.69 


0.71 


ll.lt 


0.67 


0.69 


11.2 


0.42 


0.67 


13.8 


0.39 


0.71 


14.2 


0.48 


0.62 


13.2 


0.48 


0.68 


13.2 


ITEM 


14 


0. 74 


0.49 


10*4 


0.69 


0.52 


11.0 


0.47 


0.53 


13.3 


0.37 


0.54 


14.3 


0.60 


0.47 


11.9 


0.50 


0.56 


13.0 


f TC if 

I TcM 


1 5 


2.63 


0. 55 


11.7 


0.56 


0.53 


12.4 


(1. 43 


0.37 


13. 7 


0.41 


0. 41 


13.9 


0. 38 


0.4* 


14. 2 


0. 37 


0.24 


14.3 


ITEM 


16 


Om 60 


0.78 


12.0 


0.60 


0.75 


12.0 


0.32 


0.64 


14.9 


0.32 


0.75 


14.8 


0.45 


0.72 


13.5 


0.40 


0.68 


14.1 


ITEM 


17 


0.66 


0.72 


11.4 


0.62 


0.64 


11.8 


0.42 


0.61 


13.8 


0.44 


0.48 


13.6 


C,47 


0.69 


13.3 


0.49 


0.52 


13.1 


ITEM 


18 


0.64 


0.58 


11.6 


tf.52 


0. r % 


12.8 


0.38 


0. 55 


14. 2 


0.35 


0. 49 


14.6 


0.40 


0.55 


14.9 


0.33 


0. 54 


14.8 


ITEM 


19 


0.61 


0.53 


11.9 


0.55 


0.46 


12.5 


0.43 


0.46 


13.7 


0.38 


0.37 


14.2 


0.59 


0.31 


13.0 


0.41 


0.43 


13.9 


ITEM 


20 


0*66 


0. 74 


11.3 


0.64 


0.67 


11.6 


0.35 


0.67 


14.5 


0.35 


0.58 


14.5 


0.39 


0.69 




O.M 


0.60 


13.9 


ITEM 


n 


0.55 


J. 77 


12.5 


0.51 


(1.7* 


12.9 


0.25 


0.72 


15.8 


0.23 


0.73 


16.0 


0.37 


0.61 


14.3 


0.33 


0.63 


14*7 


ITEM 


22 


0.59 


0.63 


12.1 


0.50 


0.65 


L3.0 


0.78 


0.50 


15.3 


0.22 


0.43 


16.1 


0.35 


0.43 


14.5 


•r.29 


0*58 


15.3 


ITEM 


23 


0.51 


0*67 


12.9 


0.41 


0.62 


14.0 


0.29 


0.32 


15.2 


0.24 


0.32 


15.8 


0.30 


0.45 


15.1 


0.?5 


0.3b 


15.8 


IT" 


24 


0.55 


0.65 


12.5 


0.46 


0.5* 


13.4 


J. 27 


0.66 


15*5 


0.27 


0.53 


15.5 


0.35 


0.58 


14.6 


0.25 


0.39 


15.7 


ITEM 


25 


D.50 


0.67 


13.0 


0.48 


0.52 


13.2 


0.32 


0.27 


14.8 


0.37 


0.22 


14.3 


0.34 


0.35 


14.7 


0.42 


0.30 


13.8 


MEAN 


0. 70 


0.63 


10.8 


0.64 


0.59 


11 j5 


0.46 


0.53 


13.5 


0.43 


0.49 


13.8 


0.51 


0.54 


12.9 


0.46 


0.51 


13.4 


S. 


0. 


0.11 


0.11 


1.4 


0.12 


0.1" 


1.4 


0.14 


0.11 


1.5 


0.14 


0. 14 


1.5 


0.14 


0.12 


1.4 


0.13 


0.12 


1.4 


SUMMARY! 










































MEAN 


S.O. 


MEAN 


S.O. 


MEAN S.O. 


MEAN 


S.O. 


MEAN J 


». 0. 


MEAN 


S.O. 


FORMULA SCORE 


14 


• 7 


7.0 


13.0 


6.9 


6 


• 9 6. 3 


6 


•0 


5.7 


8. 


6 6.6 


7 


• 0 


6.2 


1 *IGHT 


17.2 


5.3 


15. 


8 


5.3 


10 


• 9 4.9 


10 


• 1 


4.4 


12. 


3 5.1 


11.0 


4.9 


1 WRONG 


7 


• 3 


5.1 


8. 


3 


5.1 


11.9 5.1 


12 


• 6 


4.9 


11. 


3 5 2 


12 


• 0 


; 0 


« CHITS 


0 


• 2 


0.8 


0. 


5 


1.4 


0 


• 4 I 


1.6 


0 


• 7 


1.7 


0. 


4 ] 


1.2 


0 


.7 


1.* 


• NOT REACHED 


0 


• 4 


1.5 


ft. 


5 


1.6 


1 


• A 3.2 


1 


• 6 


3.0 


1. 


0 2.5 


1 


• 3 


3.0 


COEFFICIENT ALPHA 




0.86 






0.f)4 






0.79 






0.75 






0.81 






0.78 




SAMPLE SIZE 




5887 






5835 






823 






1048 






339 






330 




POPULATION ESTIMATE 


1023 734 


1015*37 






102915 






126309 






45288 






45883 





o 



18:j 



1 23 



9 

ERIC 



-151- 
Bll 



ITEM 1 
I TEN 2 
ITEM 3 
ITEM 4 
ITEM 5 
ITEM 6 
!TM 7 
I TEH • 
I TEN 9 
ITEM 10 
ITEM 11 
ITM 12 
ITEM 13 
1TFM 14 
I TEN 15 
1TFN 16 
ITFM 17 
ITEM 18 
ITEM 19 
ITEM 20 
ITEM 21 
ITEM 22 
ITEM 23 
ITM 24 
ITEM 25 

MEAN 
S.0. 

SUMMARY I 

FC'NUIA SCOPE 

• MGNT 
« WPONG 

# OMITS 

0 NOT HEACHEO 



MAI E 


»♦ 


00IS 


OEITA 


9.99 


0*67 


7.9 


0.62 


0.65 


11.0 


0.84 


0*62 


9.0 


o.93 


0.79 


7.0 


0.6 7 


0.73 


11.2 


0.«1 


9.01 


T.7 


0#£9 


0.74 


11.0 


0*65 


0.55 


11*4 


0.64 


0*46 


11.4 


0*84 


0.6* 


9.0 


0.76 


0.60 


10.1 


0*91 


0.85 


7.5 


0.48 


0.74 


8.2 


0*79 


0.71 


10.9 


0*00 


0.67 


9.4 


0.7* 


0.75 


10.0 


0*70 


0.01 


9.9 


0.6* 


0.53 


11.9 


o.« 


4.50 


12.8 


0.10 


0.01 


9.7 


o.e5 


0.72 


11.5 


0.30 


0.42 


14.2 


0.24 


0.42 


15.4 


O.f* 


0*67 


11.5 


0.J9 


0.59 


12.1 


o.n 


0.47 


10.* 


0*16 


0.11 


2.0 



US 1972 
LETTE0 GftOUPS 

FEMAl E 

P+ »B1S OEITA 

0.90 0.45 7.8 

0.67 0.66 11.2 

0.89 0.60 9.1 

0.94 0.74 6.8 

0.72 0.70 10.7 

0.92 0.75 7.3 

0.79 0.76 10.3 

0.72 0.54 10.7 

0.60 0*67 11.1 

0.05 0.43 0.0 

0.70 0.69 9.9 

0.99 0.04 6.5 

0.91 0.66 7.f 

0.73 0*72 10.9 

0.80 0.62 9.6 

0.92 0.82 9.3 

0.82 0.02 9.3 

0.40 0.51 11.2 

0.58 0.49 12.2 

0.85 0.06 0.9 

0.49 0,74 11.0 

0.41 0.44 13.9 

0.26 0.42 15.5 

O.n 0.72 19.0 

0.65 0.55 11.4 

0. 75 0.67 10.9 

0.16 0.12 2.1 



TCTAl 



»♦ 


90IS 


OEITA 


0.90 


0.66 


7.9 


0.65 


0.66 


11.5 


9.97 


0.62 


0.6 


0.94 


0.?7 


6.9 


0.70 


0.75 


11.0 


0.91 


0.78 


7.5 


0.72 


0.75 


10.7 


0*68 


0.95 


ii.i 


0.66 


0.66 


11.1 


0.95 


0.64 


0.9 


0.77 


9.60 


10.9 


0.93 


0.06 


7.1 


0.90 


0.71 


7.9 


0.72 


0. 72 


10.7 


0.90 


0.65 


9.6 


0.00 


0.79 


9.6 


0.00 


0.02 


9.6 


0.66 


0.52 


1 1.3 


0.59 


0. 50 


12.5 


0.02 


0.03 


9.3 


0.67 


0. 73 


11.2 


0.40 


0.43 


14.0 


0.26 


0.41 


15.6 


0.68 


9. 70 


11.2 


0*62 


0.57 


11.8 


0.73 


0.^7 


10.3 


0.14 


0.12 


2.0 



MEAN 
15.5 
16.0 
9.2 
1.2 
1.0 



S.O. 

6.0 

9.0 

9.0 

2.0 

2.0 



MEAN 
16.9 
18.0 
4.4 
1.4 
1.3 



S.O. 

5.4 

4.7 

4.5 

2.0 

? 2 



MEAN 
16.2 
17.4 
4.0 
1.3 
1.5 



S.O. 

5.9 

4.9 

4.0 

2.0 

2.4 



COEFFICIENT AlFHA 
SAM?U SIZE 
PCPUIATION ESTIMATE 



9.96 
7639 
1264701 



0.05 

7732 
12 71806 



0.86 
15748 
2559029 
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HIS 19 T2 
IETTEH G«CUPS 









WH 1 1 c 






BL ACK 






HISPANIC 








P* 


R9IS 


DELTA 


P* 


P8IS 


DELTA 


P* 


P8IS 


DELTA 


P* 


ITEM 


1 


0.92 


0.60 


7.4 


0.82 


0.72 


9.4 


0.81 


0.62 


9.5 


0.90 


ITEM 


2 


0.68 


0.66 


11.2 


0.50 


0.62 


13.0 


0.50 


0.53 


13.0 


0.65 


ITEM 


3 


0.89 


C.60 


8.2 


0.76 


0.54 


10.2 


0.77 


0.61 


10.1 


0.87 


ITEM 


4 


0.95 


0. 71 


6.3 


0.94 


0.77 


9.1 


0.87 


0.72 


8.5 


0.94 


ITEM 


5 


0*74 


0.75 


10.4 


0.45 


0.63 


13.5 


0.94 


0.68 


12.6 


0.70 


IT?M 


6 


0.93 


0.72 


7.0 


0.82 


0.79 


9.3 


0.94 


0.83 


8.9 


0.91 


ITEM 


7 


0.75 


0.75 


10.3 


0.55 


0.69 


12.5 


0.59 


0. 70 


12.1 


0. 72 


ITFM 


8 


0.72 


0.54 


10.7 


0.49 


0.45 


13.1 


0.54 


0.39 


12.6 


0.68 


ITEM 


9 


0,70 


0.66 


10.9 


0.46 


0.55 


13.4 


0.49 


0.60 


13.1 


%66 


ITFM 


10 


0.87 


0.61 


8.5 


0.73 


0.64 


10.5 


0. 75 


0.60 


10.3 


0.95 


ITEM 


11 


0.80 


0.6* 


9.6 


0.61 


0.69 


11.8 


0.61 


0. 70 


11.9 


8. 77 


ITEM 


12 


0.95 


0.84 


6.5 


0.84 


0.76 


9.0 


0.85 


0.80 


8.9 


0.93 


ITEM 


13 


0.91 


0.68 


7.5 


0.81 


0.71 


9.4 


0.82 


0.67 


9.4 


0.90 


IT?M 


14 


0*76 


0.68 


10.2 


0.51 


0.69 


12.9 


0.57 


0.69 


12.3 


0. 72 


ITFM 


15 


0.83 


0.61 


9.1 


0.60 


0.5* 


U'.O 


0. 72 


0.99 


10.6 


0. 80 


ITPM 


16 


0.84 


0.77 


9.1 


O.fO 


0.69 


17.0 


0.62 


0.69 


11.9 


0. 80 


ITEM 


17 


J.84 


0.81 


9.1 


0.58 


0.69 


.2.1 


0.64 


0.70 


11.5 


0. 80 


IT€M 


19 


0*68 


0.51 


11.1 


0.57 


0.53 


12.3 


0.58 


0.53 


12.2 


0.66 


ITEM 


19 


1.57 


0.49 


12.3 


0.41 


0.48 


13.9 


0.40 


0.47 


14.0 


0.55 


ITEM 


20 


0.86 


0.92 


9,8 


0.63 


0.73 


11.6 


0.66 


0.81 


11.4 


0.82 


ITEM 


21 


1.71 


0.7? 


10.8 


0.44 


0.62 


13.6 


0.49 


0.67 


13.1 


0.67 


I T F M 


22 


0.42 


O.St 


13.9 


0.27 


0.39 


15.4 


0.28 


0.33 


15.3 


0.40 


ITEM 


23 




0.42 


15.4 


0.19 


0.29 


17.2 


0.16 


0. 18 


17.0 


0.26 


ITEM 


24 


o.ri 


0.70 


10.8 


0.43 


0.59 


13.7 


0.54 


0.62 


12.6 


0.68 


ITEM 


25 


0.65 


0.96 


11.4 


0.43 


0.48 


13.7 


0.36 


C*45 


14.4 


0.62 


MEAN 


0.76 


0.65 


9.9 


0.97 


0.61 


12.2 


0.60 


0.61 


11.9 


0.73 


s.o. 


(1.16 


0.11 


2.1 


0.18 


0.12 


2.0 


0.18 


0.15 


2.0 


0.16 



TOTAL 



P* MIS DELTA 



0.66 
0.66 
0.62 
0.77 
0*75 
0.78 
0.75 
0.55 
0.66 
0.64 
0.68 
0.86 
0.71 
0.72 
0.65 
0.79 
0.82 
0.52 
0.50 
0. 83 
0.73 
0.43 
0.41 
0.70 
0.57 

0.67 
0.12 



7.9 
11.5 
8.6 
6.9 
11.0 
7.9 
10.7 
11.1 
11.3 
8.9 
10.0 
7.1 
7.9 
10.7 
9.6 
9.6 
9.6 
11.3 
12.9 
9.3 
11.2 
14.0 
15.6 
11.2 
11.8 

10.3 
2.0 



SUMMARY: 

MEAN 

FORMULA SCC^E 17.1 

• RIGHT 18.1 
$ W»CNG 4.2 
i CMITS 1.3 

• NOT BEACHED 1.4 

COEFFICIENT ALPHA 0.84 

SAMPLE ' IZF 11604 

POPULATION EST IMATF 2052880 



MEAN 
11.3 
13.2 
7.7 
1.5 
2.6 



S.O. 

6.3 

5.2 

6.0 

2.4 

3.5 



0.65 
1999 
231532 



MFAN 
12.2 
14.1 
7.5 
1.2 
2.2 



S.O. 

6.2 

5.0 

5.8 

2.1 

3.2 



0.84 
676 

92233 



MEAN 
16.2 
1F.4 
4.8 
1.3 
1.9 



S.O. 

5.9 

4.9 

4.8 

2.0 



0. 86 
19749 
2559029 



HIS 1972 
LETTER CROUPS 



WHITE MALE 



WHITE FEMALE 



SLACK MALE 



BLACK FEMALE 



HISPANIC MALE 



HISPANIC FEMALE 



ITEM 1 
ITEM Z 
ITEM 3 
ITEM 4 
ITEM 5 
ITEM 6 
ITEM 7 
ITEM S 
ITEM 9 
ITEM 10 
ITEM U 
ITEM 12 
ITEM 13 
ITEM 14 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM 111 
ITEM 19 
ITEM 2d 
ITEM 21 
ITEM 22 
ITFM 23 
ITEM 24 
ITEM 25 

MEAN 
S.O. 

SUMMARY I 

FORMULA SCORE 

i RIGHT 

I WRONG 

f OMITS 

I NOT REACHED 

COEFFICIENT ALPHA 
SAMPLE SUE 
POPULATION ESTIMATE 



p* 


RBIS 


DELTA 


?♦ 


RBIS 


OELTA 


P* 


RBIS 




OELTA 


0*92 


(>• 62 


7.5 


0.92 


0.59 


7.< 


0.81 


0.78 




9.5 


0*65 


0.65 


11.5 


0.71 


0.66 


10.8 


0.47 


0.65 




13.3 


0* 86 


0.61 


8.6 


0.91 


0.55 


7.6 


0.73 


0.55 




10.5 


9*95 


0.73 


6.4 


0.96 


0.69 


6.2 


J. 82 


0. 83 




9.3 


0. 71 


0.73 


10.8 


0.77 


0.77 


10.0 


0.43 


0.60 




13.7 


tf.92 


0.76 


7.3 


0.94 


0.67 


6.8 


0.80 


0.84 




9.6 


0*71 


0.74 


10.7 


0.79 


0.76 


9.8 


0.54 


0.71 




12.6 


0*68 


0.55 


11.1 


0.75 


0.5? 


10.3 


0.46 


0.41 




13.4 


£•67 


l>.£5 


11.2 


0.73 


0.66 


10.6 


0.45 


0. 56 




13.5 


0*86 


0*64 


8.6 


0.88 


0.58 


8.4 


0.72 


0.62 




10.7 


0. 79 


0.66 


9.8 


0.82 


0.t4 


«.4 


0.61 


0.66 




11.9 


0*93 


0.85 


7.0 




It 74 
19. ft 


■5 7 
5. r 










0.90 


0.71 


7.9 


0.93 


0.60 


7.1 


0.78 


0.80 




9.9 


»J* 73 


0.70 


10.5 


0.78 


0.66 


10.0 


0.50 


0.65 




13.0 


0*83 


0.64 


9.2 


0.84 


0.58 


9.1 


0.61 


0.59 




11.9 


3.81 


0.74 


9.5 


0.8T 


0. 80 


8.6 


0.58 


0.66 




12.1 


0.81 


a. 8it 


9.4 


0.86 


0. 80 


8.7 


0.57 


0.70 




12.3 


0.66 


0.51 


11.3 


0.70 


0.51 


11.0 


0.55 


0.56 




12.5 


0. 55 


0.49 


12.5 


0»60 


0.47 


12.0 


0.36 


0.42 




14.4 


0.83 


0.8J 


9.2 


0.88 


o.r 


8.3 


U. 59 


0.71 




12.1 


0.69 


0.72 


11.1 


0.73 


0.73 


10.5 


0.41 


0.63 




13.9 


0. 40 


0.42 


14.0 


0.43 


0.43 


13.7 


0.27 


0.42 




15.4 


(1.27 


0.43 


1 5.5 


0.28 


0.42 


IK* 


0.15 


U.22 




1 f. Z 


0.67 


0.68 


11.2 


0.75 


0.71 


10.' 


0.19 


0. r i4 




14.1 


0.62 


0.57 


11.7 


0.68 


0.5? 


11.1 


0.40 


0.47 




14.0 


0.74 


i}.66 


10.1 


0.78 


0.64 


9.5 


0.55 


0.61 




12.4 


0.16 


0.11 


2.1 


0.16 


0.12 


2.2 


0.18 


0.15 




2.0 


MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S 


• 0. 


16. 


4 


5.6 


17.8 


4.9 


10. 


7 


6 


• 3 


17.5 


4. f 


18. 


8 


4.1 


12.7 


5 


• 1 


4. 


7 


4.6 


3. 


8 


3.9 


A.l 


6 


• 1 


1. 


2 


?.o 


1. 


3 


1.9 


1. 


3 


2 


.1 


1. 


6 


2.6 


1. 


1 


2.0 


2. 


9 


3 


.7 




0.84 






0.82 






0.85 








5887 






*835 






823 







p* 

0.82 

0.52 

0,78 

0,85 

0.47 

0.83 

0.55 

0.51 

0.46 

0. 74 

0.62 

0.86 

0.84 

0.51 

0.59 

0.61 

0.59 

0.59 

0.45 

0.67 

0.46 

0.27 

0.15 

0.46 

0.46 

0.59 
0.18 



RBIS 

0.67 

0.60 

0,52 

0. 72 

0.65 

0. 76 

0.66 

0.47 

0. *5 

0.63 

0.68 

0.74 

0.62 

0.73 

•>.59 

0.70 

0.68 

0.49 

0.53 

0.73 

0.61 

0.37 

0.35 

0.63 

0.48 

0.61 
0.11 



OELTA 
9.3 

12 8 
9.9 
8.9 

13.3 
9.2 

12.5 

12.9 

13.4 

10.4 

11.8 
8.6 
9.0 

12.9 

12.1 

11.9 

12.1 

12.1 

13.6 

11.3 

13.4 

15.5 

17.2 
13.4 
13.4 

12 0 
2.1 



MEAN 
11.8 
13.6 
7.3 
1.7 
2.4 



S.O. 

6.2 

5.1 

5.8 

2.6 

3.4 



p* 


RBIS 




DELTA 


P* 


RBIS 


DELTA 


0. 33 


0.66 




9.2 


0.80 


0.59 


9.7 


0.50 


0. 57 




13.0 


0.51 


0.50 


12.9 


0. 76 


0.62 




10.2 


0.78 


0.57 


9.9 


0.64 


0. 75 




9.0 


0.90 


0.69 


8.0 


0.52 


0.69 




12.8 


0.55 


0.66 


12.5 


0. 81 


0.87 




9.5 


0.88 


0. 80 


8.4 


0.58 


0.71 




12.2 


0. 59 


0.68 


12.0 


U.54 


0.39 




12.6 


Oc 54 


0.38 


12.6 


0.51 


0.62 




12.? 


0.48 


0.61 


13.2 


0. 77 


0.71 




10.3 


0.73 


0.52 


10.6 


O.o3 


0.65 




11. 7 


0. 59 


0.73 


l?.l 


0.85 


0.78 




R.8 


0.85 


0.81 


8.9 


0.83 


0.74 




9.1 


0.81 


0.60 


9.5 


Oi 55 


0. 70 




12.5 


0.58 


0.69 


12.2 


0.70 


0.60 




10.9 


0.75 


0.55 


10.3 


0.60 


0.66 




12.0 


0.64 


0.72 


11.6 


0.61 


0. 73 




11. « 


0.67 


0.65 


11.2 


0.60 


0.54 




12.0 


0.56 


0.54 


12.3 


0.38 


0.44 




14.3 


0.42 


0.49 


13.8 


0.62 


0. 80 




11.7 


0.69 


0.81 


11.0 


0.51 


0.67 




12.9 


0.46 


0.67 


13.4 


0.31 


0.25 




15.0 


0.25 


0.41 


15.7 


0.17 


0.22 




16.9 


0.16 


0.15 


17.0 


0.51 


0.48 




12.9 


0.56 


0.70 


12.4 


0.30 


0.39 




15.1 


0.41 


0.45 


13.9 


0.59 


0.61 




12.0 


0.6l 


0.60 


11.8 


0.16 


0.16 




2.0 


0.18 


0.15 


2.1 


MEAN 


S.O. 


MEAN 


S.O. 


11. 


9 


6 


• 1 


12. 


5 


6.1 


13.7 


5 


• 0 


14. 


4 


5.0 
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APPENDIX C 

HS&B 1980 Senior Item Analysis Tables 



CI 1980 Vocabulary Male-Female 

C2 1980 Vocabulary White-Black-Hispanic 

C3 1980 Vocabulary White Male-White Female-Black Male- 
Black Female -Hi s panic Male-Hispanic Female 

C4 1980 Reading Male-Female 

CS 1980 Reading White-Black-Hispanic 

C6 1980 Reading White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

C7 1980 Mathematics Male-Female 

C8 1980 Mathematics White-Black-Hispanic 

C9 1980 Mathematics White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

CIO 1980 Visualization in Three Dimensions Male-Female 

Cll 1980 Visualization in Three Dimensions White-Black- 
Hispanic 

C12 1980 Visualization in Three Dimensions White Male- 
White Female-Black Male-Black Feiule-Hispanic Male- 
Hispanic Female 
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Summary: 
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0*18 


0.11 


?• 1 


0.16 


0.14 


1,7 


0.16 


0.13 




0.16 


0.12 




0.15 


0.13 


1.7 


SUMMARY! 














































MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


5.D. 


MEAN 


S.D. 


MEAN 


S.D. 


FORMULA 


SCOPF 


11.2 


6.5 


10. 


9 


6.3 


6. 


3 


5.4 


5 


• 4 


5.0 


6. 


7 


5.5 


6 


• 6 


5.4 


1 RIGHT 






14 


• 0 


5.4 


13. 


8 


5.2 


10. 


0 


4.5 


9 


• 3 * 


i • 1 


10. 


4 


4.5 


10.3 


4.5 


1 WRCNC 






11.2 


5.5 


11.5 


5.4 


14. 


7 


5.3 


15.7 


>• 1 


14.8 


5.2 


14 


• 9 


5.1 


• OMITS 






1.2 


2.5 


1.2 


2.4 


1. 


3 


2.6 


1.3 


'.6 


1.2 


2.7 


1 


• 1 


2.5 


# NOT REACHEO PI 


0.2 


1.2 


il. 


2 


1.0 


<>• 


6 


1.6 


0 


• 4 ] 


1 . 6 


0. 


3 


1.3 


0 


• 3 


1.3 


0 NOT PEACHEO P2 


0 


• 3 


1.1 


0. 


3 


1.0 


0. 


5 


1.6 


0 


• 4 


L . 4 


0.3 


1.2 


0 


• 4 


1.5 


COEFFICIENT 


AL PMA 




0.83 






0.81 






0.74 






0.69 






0.74 




0.73 




SAMPLE 


SIZE 






848? 






9060 






1195 






1728 






1198 






1421 




PfPULATIPN ESTIMATE 


987898 




1484279 




110126 






152555 






72819 






72521 





HISPANIC FEMALE 



O 



ERIC 191 



192 



-158- 
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ITEM 1 
ITEH 2 
ITEH 3 
ITFM 4 
ITFM 5 
ITEH 6 
ITEH 7 
ITEH 8 
ITFM 9 
ITEH 10 
ITEH U 
J TEH 12 
ITEH 13 
ITEM 1* 
1T*H 15 
ITEH 16 
ITFH 17 
ITEH 18 
ITEH 19 
ITEM 20 

MfcAN 

s.o. 

SUMMAPYl 

FCMulA SCOPE 
I PI GMT 

• WPCNG 
I CHITS 

• NCT PEACHED 



MAlf 



p* 


KBIS 


DEI TA 


0.80 


0.61 


9.6 


0.60 


0.70 


12.0 


0.93 


0.61 


9ml 


O.tb 


0.60 


11.4 


0.70 


0.63 


11.0 


0.76 


0.72 


10.2 


0. 50 


0.65 


13.0 


0.54 


0.67 


12. 6 


0.44 


0.56 


13.6 


0.51 


0.57 


12.9 


0.47 


0.53 


13.3 


0. ?9 


0.67 


9.8 


3.63 


0.72 


12.0 


0.32 


0.53 


14.9 


0.18 


0.42 


16.6 


0.50 


0.64 


13.0 


0.36 


0.41 


14.4 


0.70 


0.60 


10.9 


0.41 


0.48 


13.9 


0.50 


0.57 


13.0 


0.56 


0.60 


12.* 


0.17 


0.09 


1*9 



MSB 1980 SENIORS 
BEADING 

FEHAlE 



P+ P8IS OEITA 

0.81 0.59 9c > 

0.61 0.68 11.9 

0.8? 0.57 8.1 

0 . 72 0.60 10.6 

0.73 0.63 10.6 

0.72 0.6 3 10.7 

0.45 0.67 13.5 

0.55 0.71 12.5 

0.46 0.5O 13.4 

0.5* 0.61 12.1 

0.41 0.50 13.9 

0.83 0.56 9.2 

0.57 0.72 12.3 

0.27 0.54 15.5 

0.19 0.50 16.5 

0.50 0.65 13.0 

0.37 0.40 14.3 

0.67 0.57 11.2 

0.38 0.46 14.2 

0.41 0.51 13.9 

0.56 0.58 12.3 

0.19 0.08 2.1 



TOT Al 



ft P6IS DEITA 

0.60 0.61 9.6 

0.60 0.69 12.0 

0.86 0.5* 8.7 

0.6* 0.60 11.1 

0.71 0.64 10.8 

0.73 0.67 10.5 

0.47 0.66 13.3 

0.54 0.69 12.6 

0.45 0.53 13.5 

0.55 0.59 12.5 

0.43 0.51 13.7 

0*80 0.62 9.6 

0.58 0.72 12.2 

0.29 0.54 15.2 

0.18 0.46 16.6 

0.49 0.65 13.1 

0.?6 0.41 14.4 

0.68 0.59 11.1 

0.40 0.47 14.1 

0.45 0.53 13.5 

0.55 0.59 12.4 

0.18 0.08 2.0 



HEAN 


S.O. 


HEAN 


S.O. 


HEAN 


S.O. 


8.9 


5.3 


8.9 


5.0 


8.8 


5. Z 


11.0 


4.3 


11.0 


4.1 


10.9 


4 . Z 


8.5 


4.2 


8.5 


4.0 


8.6 


4. 1 


0.1 


0.6 


0.2 


0.6 


0.1 


D. 6 


0.3 


1.4 


0.3 


1.3 


0.3 


1.4 



COEFMUFNT Al PHA 
SAMPIE SIZE 
P3PUUTIDN EST1HATF 



0.80 
11362 
1216150 



0.78 
126?1 
135*^21 



0.7<? 
24892 
2661074 
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MSB 1980 SEN! CDS 
HEADING 



WHITE 

M KRIS OEITA P* 



ITEM i 0.63 0.59 

ITEM 2 0.63 0.69 

ITEM 3 0.04 0.9* 

ITEM 4 0.71 0.59 

ITEM 5 0.T4 0.61 

1TE« 6 0.77 0.66 

ITEM 7 0.52 0.64 

ITEM 8 9.58 0.67 

ITEM 9 0.46 0.52 

ITEM 1) 0.98 0.98 

ITEM 11 0.46 0.30 

ITEM 12 0.83 0.61 

ITEM 13 0.63 0.71 

ITEM 14 9.32 0.52 

ITEM IS 0.20 0.48 

ITEM If 0.54 0.63 

ITEM 17 0.39 0.40 

ITE« 16 0.72 0.56 

ITEM 19 0.^2 0.4* 

ITEM 20 0.48 0.55 

MEAN 0.56 O.M 

S.O. 0.18 0.1)6 

SUN" Aft V J 

MEAN 

EOFMUU SCORE 9.3 

* RIGHT U.6 
« wfONG e.i 
f CMfTS 0.1 

• NOT 6EACHE0 0.2 



9.2 
11.7 

8.9 
10.6 
10.4 
10.1 
12.6 
12.1 
13.2 
12.2 
13.4 

9.2 
11.7 
14.9 
16.4 
1*.6 
l<\.2 
10.7 
13.8 
13.2 

12.1 
2.0 



S.O. 

3.0 

4.1 

4.0 

0.6 

1.1 



COEFFICIENT AlPHA 0.78 
SAMPLE SIZE 17633 
POPUIATICN ESTIMATE 210*31* 



O.70 
0.47 
0.76 
0.61 
0.37 
0.37 
0.26 
0.33 
0.33 
0.42 
0.29 
0.70 
0.33 
0.13 
0.1? 
0.30 
0.30 
0. 51 
0.26 
0.30 

0.42 
0.16 



BL ACK 



0.57 
0.65 
0.52 
0.61 
0.65 
0.63 
0.61 
0.63 
0.45 
0. 50 
0.43 
0.60 
0.69 
0.54 
0.23 
0.59 
0.47 
0.50 
0.29 
0.32 

0.52 
0.12 



HISPANIC 



TOTAl 



MEAN 
5.3 
8.0 

10.6 
0.2 
1.0 



OEITA 


P* 


PBIS 


OEITA 


P* 


PBIS 


OEITA 


10.9 


0.66 


0.97 


11.3 


0.8) 


0.61 


9.6 


13.3 


0.46 


0.63 


19.4 


0.60 


0.69 


12.0 


9.9 


0.78 


0.56 


9.9 


0.86 


0.59 


8.7 


11.9 


0.56 


0. 56 


12.4 


0.69 


0.60 


11.1 


12.3 


0.55 


0.62 


12.4 


0.71 


0.64 


10.6 


12.3 


0.58 


0.60 


12.2 


0.73 


0.67 


10.9 


15.6 


0.31 


0.64 


19.0 


0.47 


0.66 


13.3 


14.6 


0.36 


0.60 


14.2 


0.54 


0*69 


12.6 


14.7 


0.29 


0.52 


15.2 


0.45 


0.53 


13.5 


13.9 


0.41 


0.51 


13.9 


0.55 


0.59 


12.5 


13.2 


0.31 


0.46 


14. 9 


0.43 


0.51 


13.7 


10.9 


0.69 


0. 59 


11.0 


0. 80 


0.62 


9.6 


14.5 


0.40 


0.63 


14.1 


0.56 


0.72 


12.2 


17.2 


0.16 


0.46 


16.9 


0.29 


0. 54 


15.2 


17.4 


0.13 


0.24 


17.6 


0.16 


0.46 


16.6 


15.1 


0.30 


0.59 


15.1 


0.49 


0.65 


13.) 


15.2 


0.30 


0.41 


15.1 


0.36 


0.41 


14.4 


12.9 


0.54 


0.46 


12.6 


0.68 


0.39 


11.1 


15.3 


0.?9 


0.27 


19.2 


0.40 


0.47 


14.1 


13.1 


0.33 


37 


14.8 


0.45 


0.53 


13.5 


13.9 


0.4? 


0.52 


13.9 


0.55 


0.99 


12.4 


2.0 


0.17 


0.11 


1.9 


0.16 


0.06 


2.0 



S.O. 

4.5 

3.7 

3.9 

0.6 

2.4 



MEAN 
5.5 
6.2 

11.0 
0.1 
0.6 



S.O. 

4.6 

3.7 

3.8 

O.f 

1.6 



MEAN 
8.8 

10.9 
6.6 
0.1 
0.3 



S.O. 

5.2 

4.2 

4.1 

0.6 

1.4 



0.7? 
3166 
284509 



0.73 

2736 
159026 



0.79 
24692 
26fl074 



19.] 

ERIC 



HSR 1980 SENIORS 
REAOING 



WHITE MALE 



WHITE FEMALE 



BLACK HALE 



ITEM 1 
ITEM 2 
ITEM 3 
ITEM 4 
ITEM 5 
ITEM 6 
FT?* 7 
ITEM 8 
ITEM 9 
ITEM 1* 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM 14 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM 18 
ITEM 19 
ITEM 20 

MEAN 
S.D. 

SUMMARY! 

FORMULA SCORE 

# RIGHT 

R NRCNG 

R CMITS 

4 MOT REACHED 

COEFFICIENT ALPHA 
SAMPIE SIZE 
POPULATION ESTIMATE 



p* 


R8IS 


DELTA 


P* 


R8IS 


OELTA 


ft. 83 


0.59 


9.2 


0.84 


0.57 


9.1 


0.63 


0.69 


11.7 


0.64 


0.68 


11.6 


0.85 


0.61 


8.9 


0.91 


0.55 


7.7 


0.67 


0.59 


11.2 


0.75 


0.59 


10.3 


0.72 


0.61 


10.6 


0.76 


0.61 


10.2 




V » f 1 




ft TC 
(J. f * 


J. 62 


i«).3 


0.54 


0.64 


12.6 


0.50 


0.64 


n.o 


0.57 


0.66 


12.3 


U.60 


0.70 


12*0 


0.46 


0.56 


13.4 


i).5J 


0.47 


13.il 


0.53 


0.57 


12.7 


0.62 


0.61 


11.8 


d. 49 


a. 53 


13.1 


0.*4 


0.48 


n.6 


O.Bl 


0.66 


9.5 


0.85 


0.54 


8.8 


0.64 


0.71 


11.6 


0.62 


0.71 


11.8 


H.34 


0.53 


14.6 


0.30 


0.51 


15.1 


0.19 


0.45 


16.5 


0.20 


0.52 


16.3 


0. 53 


0.62 


12.6 


0.54 


0.6? 


12.6 


J.37 


0.4J 


• 4.3 


0.39 


0.39 


14.1 


(I. 73 


U. 59 


10.6 


0.71 


0.56 


10.8 


0. 43 


0. 49 


13.7 


0.40 


G.4R 


14.0 


J. 53 


J.5R 


12.7 


0.44 


(1.53 


13.6 


0.58 


0.59 


12.1 


0. 59 


0.57 


12.0 


0.J7 


0.08 


1.0 


0.19 


0.08 


2.2 


MEAN 


S.D. 


MEAN 


S.O. 


9. 


5 


5.2 


9. 


7 


4.9 


11. 


6 


4.2 


11. 


7 


3.9 


8. 


1 


4.1 


8. 


0 


3.9 


0.1 


J. 6 


0. 


1 


1.6 


0. 


2 


1.1 


0. 


2 


1.0 




0.79 






0.77 






8466 






9039 





BLACK FEMALE 



HISPANIC MALE 



HISPANIC FEMALE 



P* 

0.70 
0.48 
0. 77 
0.60 
0.58 
4.60 
0.33 
0.35 
0.33 
0.40 
0.34 
0. 69 
0.40 
0.18 
0.15 
0.33 
0. 30 
0.54 
0.29 
1.33 

0.43 
0.17 



RBIS 
0.55 
0.72 
0.51 
0.65 
0.66 
(J.68 
0.59 
0.66 
0.48 
0.50 
0.42 
0.68 
0.6s 

a. 50 

0.19 

0.63 
0.45 
0.52 
0.32 
0.41 

0. 54 
0.14 



OELTA 

10.9 

13.2 

10.1 

12.0 

12.2 

12.0 

14.8 

14.6 

14.8 

14.0 

14.7 

11.0 

14.0 

16.6 

17.2 

14.8 

15.! 

12.6 

15.2 

14.7 

13.7 
1.9 



985458 



1081 745 



MEAN 

5.7 

8*'< 
10.5 

9.2 

0.9 

0.75 
1190 
109885 



S.O. 
4.8 
3.9 
4.0 
0.6 
2.3 



p* 


RBIS 


OELTA 


P* 


RBIS 


OELTA 


P* 


RBIS 


OELTA 


0.73 


0.58 


10.6 


0.66 


0.59 


11.4 


0.69 


0.54 


11.1 


0.48 


0.60 


13.2 


0.46 


0.66 


13.4 


0.46 


0.61 


13.4 


0.80 


0.52 


9.6 


0.75 


0. 60 


10.3 


0.83 


0.52 


9.2 


0.62 


0.57 


11.7 


0.54 


0.60 


12.6 


9.58 


0.53 


12.2 


A CO 
u. * * 




19 1 

12.1 


0. 54 


0. 68 


12. 6 


0. 59 


0. 55 


12.1 


0.55 


0.58 


12.5 


0.6) 


0. 61 


12.0 


0.59 


0. 59 


12.1 


0.22 


0.63 


16.1 


0.3? 


0.66 


14.8 


0.30 


0.62 


15.1 


o.n 


0.64 


15.0 


0.39 


0.60 


14.1 


0.39 


0.6? 


14.1 


0.34 


0.43 


14.6 


0.29 


0* 53 


15.2 


0.29 


0.54 


15.2 


0.43 


0.53 


13.7 


0.38 


0.51 


14.3 


0.46 


0.57 


13.4 


0.27 


0.46 


15.4 


0.35 


0.48 


14.5 


0.28 


0.50 


15*3 


0. 72 


0.52 


10.6 


0.73 


0.64 


10.9 


0.71 


0.55 


10.7 


0.33 


0.69 


1W7 


0.42 


0.65 


13.8 


0.38 


0.62 


14.2 


0.12 


0.59 


17.6 


0.18 


0.47 


16.7 


0.15 


0.42 


17.1 


0.12 


0.28 


17.6 


0.12 


0.10 


17.7 


0.13 


0.36 


17.5 


0.29 


0,56 




0.29 


0.54 


1 2 


0.33 


0.62 


14.8 


0.34 


0. 46 


15.0 


0.28 


0.45 


15.3 


0.32 


0.36 


14.8 


0.49 


9.47 


13.1 


0.55 


0.49 


12.5 


0.53 


0.46 


12.7 


0.29 


0.27 


15.3 


0.31 


0.32 


15.0 


0.27 


0.24 


15.4 


0.29 


0.25 


15.3 


0.38 


0.40 


14.2 


0.28 


0.33 


15.3 


0.42 


o.5i 


13.9 


0.43 


9.53 


13.8 


0.43 


0.51 


13.8 


0.19 


0.12 


2.2 


0.17 


0.14 


1.8 


0.19 


0.11 


2.1 


MFAN 


S.O. 


MEAN 


S.O. 


MFAN 


S.D. 


5. 


3 


4.3 


5. 


6 


4.8 


5. 


7 


4.4 


8. 


0 


3.5 


8. 


3 


3.9 


8. 


4 


3.6 


10. 


9 


3.8 


11. 


0 


4.0 


10. 


9 


3.6 


0. 


3 


0.8 


0# 


2 


0.7 


0. 


1 


0.5 


0. 


8 


2.2 


0. 


5 


1.6 


0. 


6 


1.8 




0.71 






0. 74 






0.71 






1725 






1199 






1415 




152176 






72726 






72487 





o 

ON 
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PAPT 


1 


ITEM 


1 


PAPT 


1 


ITEM 


2 


PAPT 


1 


ITEM 


3 


PAPT 


1 


ITEM 


* 


PAPT 


1 


ITEM 


5 


PAPT 


1 


ITEM 




PAPT 


1 


ITEM 


7 


PAPT 


1 


ITEM 


ft 


PART 


I 


ITFM 


9 


PAPT 


1 


ITEM 


10 


PAPT 


1 


ITFM 


n 


PAPT 


1 


ITEM 


12 


PAPT 


1 


ITEM 


13 


PAPT 


1 


ITFM 


14 


PAP i 


1 


ITEM 


15 


PAPT 


1 


ITEM 


It 


PAPT 


1 


ITEM 


17 


PAPT 


1 


ITF* 


18 


PAPT 


1 


ITEM 


1<? 


PAPT 


1 


ITEM 


20 


PART 


1 


ITEM 


21 


PAPT 


1 


ITEM 


22 


PAPT 


1 


ITE" 


23 


PAPT 


1 


ITFM 


2* 


PAPT 


1 


I Tt M 


25 


PAPT 


2 


ITEM 


1 


PAPT 


2 


ITEM 


2 


PAPT 


2 


ITEM 


3 


PAPT 


2 


ITEM 


4 


PAPT 


2 


ITEM 


5 


PA*>T 


2 


ITEM 


6 


PAPT 


2 


ITEM 


7 



MEAN 
S.O. 

SU" M APY: 

FORMULA SCL'RE 

• RIGHT 

* UPCNG 

# CMITS 

« NOT REACHFD Pi 

* Nf T REACHED P2 

COEFFICIENT At PHA 

SAMPLF S I ? F 

P n PUt ATICN ESTIMATE 



MAI E 



p* 


RBIS 


OEITA 


0.9' 


0.52 


5.6 


0.66 


0. 44 


8. 7 


0.78 


0.5° 


9.9 


O.ftO 


0.52 


9.6 


0.73 


0.79 


10.6 


0.77 


0.54 


10.0 


0.76 


0.70 


10.2 


0.93 


0.31 


7.1 


0.68 


0.58 


11.2 


0.63 


0.6ft 


11.7 


0.54 


0.52 


12.6 


0.72 


0.68 


10.6 


0.61 


0.74 


1 1. ft 


O.rS 


0.55 


11.1 


0.59 


0.48 


12.0 


0.54 


0. 77 


12.6 


0.56 


0.66 


12.4 


0.52 


0.60 


12.8 


0.64 


0.57 


11.6 


0.63 


0.73 


11.7 


0.45 


0.73 


13.5 


0.54 


0.7? 


12.6 


0.52 


0.27 


12.8 


0.43 


0.61 


13.7 


0.3ft 


0.3? 


14.2 


0.57 


0*65 


12.3 


0.51 


0.66 


12.9 


0.75 


0.77 


10.4 


0. /3 


0.39 


9.1 


0.27 


0.3' 


15.4 


0.4ft 


0.52 


13.2 


0.46 


0.42 


13.4 


0.6? 


0.58 


11.5 


0.16 


0.14 


2.0 


MEAN 


S.O. 


If. 


3 


9.5 


20. 


1 


6.5 


11. 


4 


6.2 


0. 


3 


1.0 


0. 


i 


1.? 


0. 


l 


O.fi 



0.86 
11329 
1214615 



HSB I960 SENIORS 
MATHEMATICS 

FCMAIE 



P* PPIS OEITA 

0.97 0.49 5.5 

O.BO 0.39 9.f 

0.72 0.51 10.7 

0.74 0.47 10.4 

0.68 0.76 U.l 

C.72 0.48 10.6 

0.72 0.62 10.7 

0.94 0.36 6.9 

0.6ft 0*55 11.2 

0.56 0.66 12*4 

0.*2 0.49 13.9 

0.67 0.65 11.3 

0.61 0.70 11.9 

0.63 0.5<? 11.7 

0.56 0.43 12.4 

0.S4 0.73 12.6 

0.54 0.55 12.6 

0.43 0.46 13.7 

0.5ft 0.52 12.2 

0.61 0.6* 11.11 

0.41 0. n 11.9 

0.45 0.72 13.5 

C.48 0.27 13.2 

0.35 0.52 14.5 

0.37 0.25 14.4 

0.50 0.62 13.0 
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18.6 6.0 
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WHITE MALE 



WHITE FEMALE 



ALACK MALE 



BLACK FFMALE 



HISPANIC MALE 



HISPANIC FEMAIE 



PART 1 
PART 1 
PART 1 
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PART 
PART 
PART 
PART 
PART 
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PART 
PART 
PART 
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PART 
PART 
PART 
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PART 
PART 
PART 
PART 
PART 1 
PA1T 1 
PART 2 
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PART 
PART 
PART 
PART 
PART 
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ITEM 
ITEM 
ITEM 
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ITFM 
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ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM 14 
ITEM 15 
ITFM If 
ITEM 17 
ITEM 18 
ITEM 19 
ITEM 2* 
ITEM 21 
ITFM 22 
ITEM 23 
ITEM 24 
ITEM 25 
ITEM 
ITFM 
ITEM 
ITFM 
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ITEM 

it Eh 



1 

2 
3 
4 
5 
6 
7 



MEAN 
S.O. 



P* 
0.98 
11.87 
0.82 
0.83 
i>.76 
0.80 
0.80 
9.94 
0.70 
0.65 
5.57 
0.75 
0.65 
0. 72 
0.61 
0.56 
0.57 
0.55 
0.66 
0.68 
0.48 
0.58 
0.53 
0.47 
0.39 
0.60 
0.54 
0.78 
0.84 
0.29 
0.49 
0.47 

0.65 
0.16 



RBIS 
0.50 
0.43 
0.58 
0.50 
0.78 
0.54 
0. 70 
0.23 
0.60 
0.68 
(1.50 
0.67 
11.72 
0. 49 
0.48 
0.78 
0.67 
0.58 
0.56 
0. 72 
0.72 
0.72 
0.25 
0.60 
0.44 
0.66 
0.68 
0.77 
0.38 
0.35 
0.56 
0. 43 

0.57 
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5.1 
8.5 
9.4 
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9.7 
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6.9 

10.9 
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15.2 
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13.3 
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SUMMARY! 

MEAN S.O. 

FORMULA SCORE 17.3 8.2 

* RIGHT 20.9 6.2 
< WRONG U.6 6.0 

* OMITS 0.3 1.0 
» NOT REACHED PI 0.1 1.1 

* NOT R EACHEO P2 0.1 0.8 

COEFFICIENT ALPHA 0.86 

SAMi»LF SUE 8444 



P4 
0.98 
0.81 
0.75 
0.77 
0.73 
0.75 
0.77 
0.96 
0.70 
0.59 
0.44 
0.69 
0.64 
0.68 
0.58 
0.57 
0.56 
0.45 
0.60 
0.66 
0.45 
0.49 
0.50 
0.39 
0.37 
0.52 
0.36 
0.78 
0.83 
).22 
0.46 
0.51 



RBIS 
0.38 
0.38 
0.51 
0.47 
0.75 
0.49 
0.59 
0.27 
0.55 
0.65 
0.47 
0.65 
0.68 
0.55 
0.44 
0.7? 
0.58 
0.44 
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0.63 
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0.71 
0.26 
0.50 
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0.63 
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0.45 
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4.7 
9.4 
10.3 
10.1 
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12.0 
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13.5 
13.1 
13.0 
14.2 
14.4 
12.8 
14.5 
9.9 
9.2 
16.1 
13.4 
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P* 
0.93 
0.75 
0.60 
0.68 
0.52 
0.64 
0.46 
0.90 
0.57 
0.44 
0.36 
0.60 
0.41 
0.50 
0.48 
0.37 
0.47 
0.36 
0.47 
0.39 
0.22 
0.28 
0.42 
0.27 
0.35 
0.40 
0.32 
0.58 
0.77 
•>.19 
0.41 
0.40 
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0.48 
0.35 
0.45 
0.47 
0.70 
0.41 
0.58 
0.48 
0.45 
0.f5 
0.48 
0.64 
0.71 
0.61 
0.*6 
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0.57 
0.64 
0.49 
0.64 
0. 70 
0.65 
0.20 
0.45 
0.09 
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0.78 

0.34 
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7.1 
10.4 
12.0 
11.1 
12.8 
11.5 
12.4 
8.0 
12.3 
1?.6 
14.5 
12.0 
13.9 
13.0 
13.2 
14.3 
13.3 
14.5 
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14.1 
16.0 
15.3 
13.1 
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14.5 
14.0 
14.9 
12.2 
10.1 
16.5 
13.9 
14.0 
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0.92 
0.73 
0.59 
0.61 
0.44 
0.58 
0.49 
0.85 
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0.36 
0.24 
0.54 
0.38 
0.38 
0.45 
0.35 
0.47 
0.34 
0.44 
0.41 
0.29 
0.21 
0.38 
0.21 
0.38 
0.36 
i).21 
0.56 
0.77 
•1.16 
0.3? 
0.49 
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0.55 

0.34 

0.3? 

0.35 

0.70 

0.25 
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0. 40 

0.44 

0.55 

0.46 

0.60 

0.68 
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0.21 

0.68 

0.40 

0.41 

0.50 

0.53 

0.62 

0.49 

0.20 

0.54 

0.21 

0.45 

0.30 

0.58 

0.22 

0.2 4 

0.31 

0.16 



OELTA 

7.3 
10.5 
12.1 
11.9 
13.6 
12.2 
13.1 
8.8 
12.4 
14.4 
15.8 
12.6 
14.2 
14.2 
13.5 
14.5 
13.3 
14.7 
13.6 
13.9 
16.4 
16.2 
14.2 
16.3 
14.2 
14.4 
16.2 
12.4 
10.1 
17.0 
14.8 
13.1 



P> 
0.94 
0.81 
0.62 
0.71 
0.56 
0.65 
0.60 
0. 89 
0.57 
0.51 
0.42 
0.60 
0.45 
0.54 
0.5) 
0.41 
0.43 
0.38 
0.51 
0.44 
0.30 
0.40 
0.46 
0.28 
0.31 
0.42 
0.35 
0.55 
0.80 
0.21 
0.38 
0.41 



RBIS 
0.50 
0.39 
0.51 
0.53 
0.77 
0.45 
0.64 
0.47 
0.46 
0.58 
0.50 
0.69 
0.75 
0.66 
0.45 
0.69 
0.62 
0.56 
0.47 
0.60 
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0.62 
0.34 
0.59 
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0.48 
0.74 
0.48 
0.18 
0.34 
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6.7 
9.5 
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12.9 
13.8 
12.9 
13.6 
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13.7 
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14.0 
13.4 
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9.7 
16.4 
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0.57 
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0.41 
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0.44 
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0.45 
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0.26 
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0.37 
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0.50 
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13.9 
14.6 
12.3 
13.6 
13.3 
13.6 
13.9 
13.5 
14.8 
13.4 
13.7 
15.6 
15.0 
14.0 
15.7 
14.9 
14.0 
15.6 
12.1 
9.6 
17.0 
14.3 
13.5 

2 
1 



o 



199 



200 
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C10 



HSB l«BO 
VISUALIZATION IN 







MAI 


5 




FEMAIE 






Po MI! 


> OEITA 




► PUIS OEITA 


ITEM 


1 


9.94 


0.3. 






>4 0.47 6.9 


ITEM 


2 


0*76 


0.61 






rO 0.99 10.9 


ITEM 


3 


0.66 


0.6: 






'2 0.60 11.8 


ITEM 


4 


0.«9 


0.61 






>5 0.98 19.9 


ITEM 


9 


0.93 


0.63 






►5 0.69 19.9 


ITEM 


6 


0*46 


0.61 






»0 0.98 14.0 


ITEM 


7 


0.70 


0.64 






>7 0.97 1U2 


ITEM 


8 


0.49 


0.6: 






»9 0.60 13.5 


ITEM 


9 


1.63 


0.61 






* 0.63 11.7 


ITEM 


10 


fi.48 


0.6< 






>9 0.96 14.1 


ITEM 


11 




0.64 






!4 0.48 19.8 


ITEM 


12 


0.40 


0.6! 






»3 0.96 14.6 


ITEM 


13 


0.29 


0.34 






13 0.28 14.8 


ITEM 


14 


0.98 


0.61 






11 0.99 19.0 


ITEM 


19 


0.4A 


0.94 






►1 0.39 13.9 


ITEM 


16 


0.09 


0.31 






>4 0.?8 19.9 


MEAN 


0.91 


0.9 


B 12.9 


0.4 


►6 0.92 13.4 


S.O. 


0.20 


0.0< 




0.2 


>0 0.11 2.7 



SUMMAPVt 

MEAN Si 

PCPMifiA SCOPE 6.2 4. 

f PlGHT 8*1 3. 

f UPONC 7>>9 3* 

• OMITS 0.3 0. 

f NCT PEACHED 0.1 0. 

CCEFMCIENT AlFHA 0.73 
SAMPLE SUE 10977 

PCPU1ATIGN ESTIMATE 1180134 



EN10PS 
MPEF DIMENSIONS 



MEAN 
9.3 
7.3 
8.2 
0.3 
0.1 

0.69 
12099 
1299416 



S.O. 
3.6 
2.9 
3.0 
1.0 
0.6 



DEI 



MEAN 
9.7 
7.7 
7.9 
0.3 
0.1 

0.70 
23869 
2961037 
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Cll 



MSB 1980 SENIOBS 
VISUALIZATION IN THftCE DIMENSIONS 



ITCH 1 

m« 2 

ITEM 1 
ITCH 4 
ITEM 3 
ITEM 4 
ITM T 
ITM f 
ITM % 
ITEM 10 
ITM II 
ITEM U 
ITEM II 
ITM 14 
ITM IS 
ITCH 1ft 

MEAN 

StiNNABVt 

*0MUU Stent 

• M81T 
f M»'?NB 

• OMITS 

9 NOT M ACHED 

COIMICIINT AIPHA 
SANBLE SI XI 
'CPULATIO* ESTIMATE 





WHITE 








MIS 


DELTA 




0.95 


0.%4 


4.4 


o.e* 


0.T5 


0.51 


10.3 


0.51 


0.46 


0.60 


11.3 


0.45 


0.49 


0.59 


13.1 


0.33 


0.52 


0»ft2 


12. • 


o.sr 


0.46 


0.40 


13.4 


0.?9 


$.70 


0.60 


10.9 


0.54 


0.90 


0.60 


13.0 


0.2T 


0.66 


0.45 


11.4 


0*43 


0.45 


0.41 


13.9 


0.30 


••12 


0.5ft 


14.9 


0.20 


0.39 


0.59 


14.2 


0.24 


>.9I 


0.32 


15.0 


0.31 


0.16 


0*51 


14.4 


0.23 


*.45 


0.49 


13.5 


0.39 


0.05 


0.37 


19. T 


0.05 


0.50 


0.55 


13.0 


0.3ft 


0.20 


0.09 


2.T 


O.lt 



•LACK 



HISMNIC 



TOTAL 



••IS OELTA P+ »BIS OCITA P+ MIS DELTA 



MEAN 
4.1 
••0 
T.ft 

0.3 

0.1 

0.70 
IT264 
20436 fit 



S.O. 
B.I 
3.1 
3.2 
1.0 
9. ft 



0.45 
0.51 
0. 5ft 
0.54 
0.62 
0.52 
0*57 
0.64 
0. 59 
0.51 
0*45 
0.44 
0.19 
0.47 
0.41 
0*13 

0.47 
0.14 



I. ft 

12.2 
13.5 
U.T 
15.1 
15.2 
12.5 
15.5 
1B.T 
15.1 
K.4 
li.A 
1^.9 
14.0 
14.1 
19.4 

14.5 
2.2 



MEAN 
3.4 
3.1 
9.T 
0.4 
0.2 

0.57 
2417 
2(1493 



S.O. 
3.2 
2.6 
2.9 
1.1 
1.0 



0.90 
0.45 
0.57 
0.39 
0.40 
0.37 
0.42 
0.37 
0.54 
0.3 B 
0.23 
0.31 
0.29 
0.28 
0.39 
0.05 

0.42 
0.19 



0.48 
0.5ft 
0.40 
0.52 
0*40 
0.93 
0.59 
0.61 
0.41 
0.51 
0.4ft 
0.95 
0.24 
0.52 
0.43 
0.29 

0.50 
0.11 



1.0 

11.4 
12.3 
14.1 
14.1 
14.3 
11. ft 
14.3 
12.4 
14.2 
14.0 
13.0 
13.2 
19.3 
14.2 
19. B 

13.9 
2.4 



ME A* 
4.5 
4.7 
9.9 
0.2 
0.2 



S.O. 

3.« 

2. ft 

3.0 

0.6 

O.o 



0.94 
0.73 
0.44 
0.46 
0.4« 
0.44 
0.45 
0.47 
0.43 
0.43 
0.30 
0.3T 
0.31 
0.34 
0.44 
0.03 

0.48 

0.20 



0.49 
0.58 
0.41 
0.99 
0.44 
0.*0 
O.ftl 
0.42 
0.45 
O.ftl 
0.58 
0.99 
0.30 
0.58 
0.47 
0.34 

0.35 
0.10 



4.9 
18.4 
11.4 
13.4 
13.1 
13.4 
11.1 
13.3 
11.7 
13.7 
19.1 
14.3 
15.0 
14.4 
13.4 
19.4 

13.2 
2.4 



0.43 

2601 
14699* 



MEAN 
5.7 
7.7 
7.9 
0.9 
0.1 

0.70 
23863 
25*1037 



3.0. 
3.9 
9.1 
3.2 
1.0 
0.8 
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HSfl 1980 SENIORS 
VISUALIZATION IN THREE OIMFNSIONS 



WHITE HALE 



WHITE FENAIE 



BLACK MAlE 



81ACK FEMAIE 



HISPANIC MAlE 



HISPANIC FEMALE 



P* RBIS OELTA 

I TEN * 1 0.95 0.4* 6.3 

ITEM 2 0. 78 0.59 9.9 

ITEM 3 0.68 0.62 11.1 

-TEN * D.51 0.61 12.9 

I TEN 5 0.56 0.62 12.* 

ITEM 6 0. 50 0.60 13.0 

ITEM 7 J. 71 1.63 10.7 

ITEM 8 0.52 0.61 12.8 

ITEN 9 0.65 0.6C 11.* 

ITEM 10 J.5> 9.65 13.0 

ITEM 11 0.39 0.64 14.1 

ITEN 12 9.41 J. 63 13.9 

ITEN 13 0.30 0.36 15.1 

ITEN 1* 0.*!) 0*60 14.0 

ITEN 15 1.49 0.55 13.1 

ITEM 16 0.05 0.40 19.4 

MEAN 
S. 0. 

SUNN A* "t 

FORMULA SCOPE 
I RIGHT 
I WRONG 
* CNITS 
I NOT REACHEO 

COEFFICIENT ALPHA 9.73 

SAMPLE SIZE 8228 
POPULATION ESTIMATE «69478 



0.53 0.58 12.7 
0.20 0.09 2.7 



MEAN 
6.6 
8.4 
7.2 
0.3 
0.1 



s.o. 

4.0 

3.3 
3.3 
A.9 
0.8 



P* 
0.95 
0.72 
0.64 
0. + 7 
0.48 
0.42 

t>.6<; 

0.48 
0.66 
0.41 
0.25 
0.36 
0.32 
0.32 
0.42 
0.0* 

0.48 
0.21 



RBIS 
0.44 
0.55 
0.59 
0.58 
0.62 
0.58 
0.57 
0.58 
0.63 
u.56 
0.49 
0.56 
0.31 
t). 55 
0.41 
3.32 

9.52 
0.1O 



DELTA 

6.4 
1U.6 
11.5 
13.3 
13.2 
13.8 
11. a 
13.2 
11.4 
13.9 
I 5. A 
14.4 
14.8 
14.8 
13.8 
19.9 

13.2 
2.8 



MEAN 
5.6 
7.6 
8.0 
0.3 
0.1 

tU 65 
8713 
1046318 



S.O. 
3.6 
2.9 

3.0 
1.0 
0.8 



P* 
0.88 
0.62 
0.49 
0.37 
0.34 
0.33 
0.57 
0.30 
0.43 
0.33 
0.23 
0.28 
0.28 
0.26 
0.4? 
0.04 

0.^9 
0.18 



* IS 
0.45 
9.53 
0.57 
0.55 
0.65 
0.53 
0.63 
d. 65 
0.66 
4.58 
0.58 
0. 41 
0.18 
0.52 
i). 48 
9.21 

0.51 
0.14 



ME*N 
3.8 
6.1 
9.3 
0.3 
0.2 



DELTA 

8.4 
11.8 
13.1 
14.3 
14.6 
14.8 
12.3 
15.1 
13.7 
14.7 
16.0 
15.3 
15.4 
H-5 
13.9 

2 a. a 

14.3 
2.3 



S.O. 

3*S 

2.<; 

3.0 
1.0 
1.0 



p* 

0.86 
0.55 
0.42 
0.31 
0.27 
0.27 
0.53 
0.24 
0.43 
0.27 
0.18 
0.23 
0.34 
0.21 
0.38 
9.06 

0.35 
0.18 



RBIS 
0.45 
0.47 
0.56 
0.52 
0.58 
0.50 
0.54 
0.63 
0.55 
9.4() 
0.32 
0.41 
0.23 
9.41 
0.34 
9.13 

0.44 
0.13 



OELTA 

8.7 
12.5 
13.8 
15.0 
15.5 
15.5 
12.7 
15.9 
13.7 
15.4 
16.6 
15.9 
14.6 
16.3 
14.3 
1«.4 

14.7 
2.2 



MEAN 
3.0 
5.5 
9.9 
9.4 
0.2 



S.O. 

2.9 

2.4 

2.7 

1.2 

0.9 



P* 
O.90 
0.73 
0.61 
0.38 
0.45 
0.4? 
0.65 
0.18 
0.56 
0.43 
0.29 
0.34 
0.26 
0.30 
0.40 
O.05 

0.45 

0.',9 



PAIS 
0.48 
0.59 
0.61 
0. 55 
9.59 
0.55 
0.64 
0.66 
0.63 
0.54 
0.58 
0.59 
0.28 
0.56 
0.48 
0.25 

0.53 
0.11 



NFAN 
4.9 
7.1 
8.5 
1.2 
0.2 



OELTA 


P* 


^BIS 


OELTA 


7-9 


0.90 


0. 49 


8.0 


19.9 


0.62 


9. 53 


11.7 


11.9 


0.54 


0.59 


12.6 


14.2 


0.41 


0.53 


13.9 


13.5 


0.35 


9.61 


14.6 


13.8 


0.33 


0.48 


14.8 


11.5 


0.62 


0.53 


11.8 


14.2 


0.38 


0.56 


14.2 


12.4 


0.57 


0.59 


12.3 


13.7 


0.33 


0.45 


14.8 


15.2 


0.17 


0.25 


1.6.9 


14.6 


0.29 


0.53 


15.2 


15.6 


0.33 


9.23 


14.8 


15.1 


0.27 


0.44 


15.5 


14.0 


0.38 


0.35 


14.2 


19.6 


9.94 


9.20 


20.0 


13.6 


0.41 


0.46 


14.1 


2.4 


0.20 


0.13 


2.5 


S. n. 


MEAN 


S.O. 


3.8 


4. 


2 


3.2 


3.0 


6. 


5 


2.6 


?.? 


9. 


2 


2.7 


9.7 


II. 


3 


9.9 


1.0 


0. 


1 


0.9 



0.64 
1127 
103870 



9.48 
1568 
137976 



9.68 
1139 
70329 



0.55 
1350 
67637 



20 



On 



0 
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APPENDIX D 

HS&B 1980 Sophomore Item Analysis Tables 



Dl 1980 Vocabulary Male-Female 

D2 1980 Vocabulary White-Black-Hispanic 

D3 1980 Vocabulary White Male-White Female-Black Maie- 
Black Female-Hispanic Male-Hispanic Female 

DA 1980 Reading Male-Female 

D5 1980 Reading White-Black-Hispanic 

06 1980 Reading White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

D7 1980 Mathematics Male-Female 

D8 1980 Mathematics White-Black-Hispanic 

M 1980 Mathematics White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

D10 1980 Science Male-Fesale 

Dll 1980 Science White-Black-Hispanic 

D12 1980 Science White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

D13 1980 Writing Male-Female 

D1A 1980 Writing White-Black-Hispanic 

D1S 1980 Writing White Male-White Female-Black Male-Black 
Female-Hispanic Male-Hispanic Female 

D16 1980 Civics Education Male-Female 

D17 1980 Civics Education White-Black-Hispanic 

D18 1980 Civics Education White Male-White Female-Black 
Male-Black Female-Hispanic Male-Hispanic Female 
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Dl 



HS6 1980 SOPHOMORES 
VOCABULARY 



ITEM 
ITEM 
ITEM 
ITEM 
ITEH 
ITEM 
ITEM 
ITEM 
ITFM 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM 14 
ITEM 15 
ITEH 16 
ITEM IT 
ITEM IS 
ITEM 19 
ITEM 20 
ITEM 21 



MEAN 
S.O. 

SUMMARY: 



MAL ? 



0.74 
0.88 
0.67 
0.80 
0.77 
0.53 
0.53 
0.77 
0.55 
0.59 
0.68 
0. 74 
0.37 
0.28 
0.24 
0.43 
0.36 
0.28 
0.27 
0.22 
0.28 



0.73 
0.73 
0.75 
0.71 
0.75 
0.69 
0.69 
0.74 
0.69 
0.66 
0.68 
0.63 
0.60 
0.59 
0.30 
0.48 
0.61 
0.46 

o.u 

0.27 
0.48 



10.5 
8.4 
11.2 
9.6 
10.0 
12.7 
12.7 
10.0 
12.4 
12.1 
11.2 
10.4 
14.3 
15.3 
15.6 
13.7 
14.5 
15.4 
15.4 
16.0 
15.3 



0.52 0.59 12.7 
0.21 0.17 2.3 



MFAN 

FORMULA SCORE 8.6 

• RIGHT 10.9 
I WRONG 9,1 

• OMITS 0.7 
I NOT REACHED 0.3 

COEFFICIENT ALPHA 0.80 

SAMPLE SIZE 12H5 

POPULATION ESTIMATE 1681143 



S.O. 
5.2 
4.3 
4.4 
1.9 
1.4 



FEMALE 



TOTAL 



R8IS OELTA P+ 



0.76 
0.60 
0.66 
0.78 
0.79 
0.46 
0.60 
0.66 
0.64 
0.51 
0.65 
0.59 
0.43 
0.29 
0.23 
0.46 
0.36 
0.24 
0.30 
0.20 
0.33 



0.72 
0.74 
0.76 
0.71 
0.69 
0.68 
0. 75 
0.69 
0.70 
0.59 
0.65 
0.55 
0.63 
0.64 
0.32 
0.51 
0.58 
0.44 
0.19 
0.31 
0.58 



0.51 0.59 
0.19 0.15 



OELTA 


P* 


10.2 


0.75 


9.6 


0.84 


11.4 


0.66 


10.0 


0.79 


9.7 


0.78 


13.4 


0.50 


12.0 


0.56 


11.4 


0.71 


11.6 


0.60 


12.9 


0.55 


11.5 


0.66 


12.0 


0.67 


13.7 


0.40 


15.2 


0.29 


16.0 


0.24 


13.4 


0.4S 


14.5 


0.36 


15.8 


0. 26 


15.1 


0.29 


16.3 


0.21 


14.7 


0.31 


12.9 


0.52 


2.1 


0.20 



KAIS OELTA 



MFAN 
6.3 

10.7 
9.5 
0.7 
0.1 



S.O. 

5.4 

4.4 

4.5 

1.8 

0.9 



0.72 
0.73 
0.75 
0.71 
0.72 

Dr68 

0.72 
0.71 
0.69 
0.62 
0.67 
0.58 
0.61 
0.61 
0.31 
0.49 
0.59 
0.46 
0.16 
0.29 
0.53 

0.59 
0.16 



10.3 
9.1 
U.3 
9.R 
9.9 
13.0 
12.4 
10.7 
1?.0 
12.5 
U.3 
U.3 
14.0 
15.3 
15.9 
13.5 
14.3 
15.6 
15.2 
16.2 
15.0 

12.6 
2.2 



0.81 
12718 
1685300 



MEAN 

8.5 
10.8 

9.3 

0.7 

0.2 

0.80 
24833 
3766443 



S.O. 
5.3 
4.3 
4.5 
1.9 
1.2 



One 

\) v./ 
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D2 



ITEM 1 
ITEM 2 
ITFM 3 
ITFM 
ITEM 
ITEM 
I TE* 
ITCH 
I UK 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM 1* 
ITEM 15 
ITEM 16 
ITEM IT 
ITEM 16 
ITEM 19 
ITEM 20 
ITEM 21 



MEAN 
S.O. 

SUMMARY! 



0.82 
0.90 
0.73 
0.87 
0.84 
0.56 
0.62 
0,79 
0.*5 
0.61 
0.71 
0.72 
0.45 
0.32 
0.25 
0.48 
0.39 
0.29 
0.?9 
0.21 
0.34 

0.56 
0.22 



WHITE 



HS8 1980 SOPHOMORES 
VOCABULARY 

BLACK 



HISPANIC 



TOTAL 



P* R8IS OELTA P* RBIS OELTA P* RfllS OELTA P* RBIS DELTA 



0.70 
0.71 
0.75 
0.63 
0.69 
0.69 
0.72 
0.64 
0.68 
0.60 
0.68 
0.56 
0.63 
0.62 
0.36 
C.47 
0.62 
0.48 
0.18 
0.36 

0.5; 

0.59 
O.U 



9.4 
8.0 
10.6 
8.4 
9.0 
12.4 
11.8 
9.8 
11.4 
11.9 
10.6 
10.6 
13.5 
14.8 
15.8 
13.2 
14.1 
15.3 
15.2 
16.2 
?4.7 

12.2 
2.5 



FORMULA SCORE 

f RIGHT 

f WRONG 

f OMITS 

$ NOT REACHED 

COEFFICIENT ALPHA 
SAMPLE SIZE 
POPULATION ESTIMATE 



MFAN 
9.7 

11.8 
8.4 
0.7 
0.2 



S.D. 

5.0 

4.1 

4.2 

1.8 

1.0 



0.42 
0.63 
0.47 
0.52 
0.61 
0.30 
0.36 
0.47 
0.42 
0.34 
0.55 
0.49 
0.2R 
0.16 
0.21 
0.32 
0.26 
0.17 
0.28 
0.22 
0.20 



0.63 
0.62 
0.65 
0.68 
0.62 
0. 55 
0.59 
0.60 
0.64 
0.50 
0.52 
0.44 
0.48 
0.53 
0.17 
0.53 
0.46 
0.36 
0.17 
0.19 
0.41 



12.8 
11.7 
13.3 
12.8 
11.9 
15.1 
14.4 
13.3 
13.8 
14.7 
12.5 
13.1 
i>.3 
16.6 
16.3 
14.9 
15.6 
16.6 
15.3 
16.1 
16.4 



0.37 0.49 14.4 
0.14 0.15 1.6 



MEAN 
4.7 
7.7 

12.1 
0.8 
U.4 



S.O. 

4.6 

3.8 

4.3 

2.0 

1.7 



0.58 
0.72 
0.50 
0.60 
0.62 
0.35 
0.43 
0.5* 
0.44 
0.43 
0.50 
0.53 
0.29 
0.18 
0.21 
0.37 
0.26 
0. 20 
0.30 
0.21 
0.24 

0.40 
0.16 



0.66 
0.^7 
0.65 
0.65 
0.67 
0.56 
0.^3 
O.oS 
0.60 
0.55 
0.57 
0.50 
0.50 
0.46 
0.17 
0.45 
0.45 
0.30 
0.18 
0.19 
0.43 

0.50 
0.16 



12.1 
10.7 
13.0 
12.0 
11.7 
14.6 
13.7 
12.7 
13.6 
13.7 
13.0 
12.7 
15.2 
16.7 
16.2 
14.4 
15.6 
16.4 
15.1 
16.3 
15.9 

14.1 
1.7 



MEAN 
5.5 
8.4 

11.6 
0.7 
0.3 



S.O. 

4.7 

3.9 

4.3 

1.9 

1.6 



0.75 
0.84 
0.66 
0.79 
0.78 
0.50 
0.56 
0.71 
0.60 
0.55 
0.66 
0 67 
0.40 
0.29 
0.24 
0.45 
0.36 
0.26 
0.29 
0.21 
0.31 

0.52 
0.20 



0.72 
0.73 
0.75 
0.71 
0.72 
0.68 
0. 72 
0.71 
0.69 
0.62 
0.67 
0.58 
0.61 
0.61 
0.31 
0.49 
0.59 
0.46 
0.16 
0.29 
0.53 

0.59 
0.16 



10.3 
9.1 
11.3 
9.8 
9.9 
13.0 
12.4 
10.7 
12.0 
12.5 
11.3 
11.3 
14.0 
15.3 
15.9 
19.5 
14.5 
15.6 
15.2 
16.2 
15.0 

12.8 
2.2 



0.79 
16850 
2739849 



0.72 
3066 
451380 



0.73 
420? 
483544 



MEAN 

8.5 
10.8 

9.3 

0.7 

0.2 

0.80 
24633 
3766443 



S.O. 
5.3 
4.3 
4.5 
1.9 
1.2 



207 



HSB 1980 SOPHOMORFS 
VOCABULARY 



wHITE MALE 



WHITE FEMALE BLACK MALE BLACK FEMALE HISPANIC MALE HISPANIC FEMALE 



ITEM I 
ITEM 2 
ITEM 3 
ITEM 4 
ITEM 5 
ITEM 6 
ITEM 7 
ITEM 8 
ITEM 9 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM 14 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM IS 
ITEM 10 
ITEM 20 
ITEM 21 

MEAN 
S.O. 

SUMMARY: 

FORMULA SCORE 
I RIGHT 

• WRONG 
i OMITS 

• NOT REACHED 

COEFFICIENT ALPHA 
SAMPLE SUE 
POPULATION FSTIMATF 



P* 
0.80 
0.93 
0.73 
0.88 
0.83 
0.60 
0.58 
0.84 
0.61 
0.66 
0.73 
0.81 
0.41 
0.32 
0.25 
0.46 
0. 39 
0.31 
0.27 
0.22 
0.31 

0.57 
0.23 



RBIS 
0.71 
0.72 
0.75 
0.64 
0.74 
0.69 
0.70 
0.71 
0.69 
0.63 
0.70 
0.58 
0.62 
0.61 
0.36 
0.47 
0.65 
0.50 
0.15 
0.35 
0.51 

0.59 
0. 15 



DELTA 
9.6 
7.2 

10.5 
8.3 
9.2 

12.0 

12.2 
9.0 

11.9 

11.4 

10.6 
9.5 

13.9 

14.9 

15.7 

13.4 

14.1 

15.0 

15.4 

16.1 

15.0 

12.1 
2.7 



MEAN 

9.8 
11.9 

8.2 

0.7 

0.2 

0.78 
8271 
1150054 



S.D. 
4.9 
4.0 
4.1 
1.9 
1.1 



P* 

0.83 
0.86 
0.73 
0.87 
0.35 
0.52 
0.66 
0.73 
0.70 
0.56 
0.69 
0.64 
0.48 
0.33 
0.24 
0.50 
0.39 
0.26 
0.30 
0.20 
0.37 

0.56 
0.21 



RBIS 

0.69 

0.71 

0.76 

0.63 

0.65 

0.68 

0.74 

0.66 

0.69 

0.59 

0.67 

0.56 

0.64 

0.63 

0.36 

0.48 

0.60 

0.45 

0.21 

0.37 

0.59 

0.59 
0.14 



DELTA 
9.1 
8.6 
10.6 
8.6 
8.8 
12.8 
11.3 
10.5 
1 1.0 
12.4 
11.0 
11.5 
13.2 
14.8 
15.8 
13.0 
14.1 
15.5 
15.0 
16.3 
14.3 

12.3 
2.4 



MEAN 

9.5 
11.7 

8.6 

0.6 

0.1 

0.79 
8579 
1389794 



S.D < 
5.1 
4.1 
4.2 
1.7 
0.8 



P* 
0.52 
0.71 
0.51 
0.57 
0.61 
0.35 
0. 35 
0.55 
0.40 
0.33 
0.56 
0.52 
0.27 
0.19 
0.21 
0.33 
0.28 
0.19 
0.28 
0.24 
0.20 

0.39 
0.16 



RBIS 

0.65 

0.62 

0.66 

0.67 

0.66 

0.57 

0.54 

0.62 

0.66 

0.56 

0.53 

0.53 

0.49 

0.51 

0.15 

0.51 

0.46 

0.34 

0.17 

0.16 

0.36 

0.50 
0.16 



DELTA 

12.B 

10.7 

12.9 

12.3 

11.8 

14.5 

14.5 

12.5 

14.0 

14.8 

12.4 

12.8 

15.5 

16.5 

16.2 

14.8 

15.4 

16.5 

15.4 

15.8 

16.4 

14.2 
1.7 



MEAN 

5.1 

8.0 
11.6 

0.8 

0.5 

0.73 
1387 
214947 



S.D. 
4.7 
3.8 
4.3 
2.0 
2.0 



P* 
0.52 
0.55 
0.44 
0.48 
0.60 
0.26 
0.37 
0.41 
0.44 
0.34 
0.54 
0.46 
0.29 
0.17 
0.21 
0.31 
0.?4 
0.16 
0.29 
0.20 
0.19 

a.3s 

0.14 



RPIS 

0.62 

0.62 

0.64 

0.69 

0.59 

0.51 

0.63 

0.56 

0.64 

0.45 

0.50 

0.35 

0.48 

0.55 

0.20 

0.56 

0.45 

0.3B 

0.17 

0.21 

0.45 

0.49 
0.15 



DELTA 

12.8 

12.5 

13.6 

13.2 

11.9 

15.6 

14.3 

13.9 

13.6 

14.6 

12.6 

13.4 

15.2 

16.8 

16.3 

14.9 

15.8 

17.0 

15.2 

16.4 

16.5 

14.6 
1.5 



MFAN 
4.3 
7.4 

12.6 
0.7 
0.3 



S.O. 

4.5 

3.7 

4.1 

2.1 

1.4 



P* 
0.58 
0.77 
0.50 
0.63 
0.61 
0.36 
0.42 
0.59 
0.41 
0.45 
0.51 
0.59 
0.27 
0.19 
0.22 
0.34 
0.25 
0.20 
0.29 
0.22 
0.22 

0.41 
0.17 



RBIS 

0.66 

0.65 

0.65 

0.64 

0.68 

0.57 

0.59 

0.66 

0.60 

0.57 

0.59 

0.57 

0.48 

0.40 

0.12 

0.40 

0.45 

0.31 

0.18 

0.18 

0.38 

0.49 
0.17 



DELTA 

12.2 

10.1 

13.0 

11.7 

11.9 

14.4 

13.8 

12.1 

13.9 

13.5 

12.9 

12.0 

15.5 

16.6 

16.1 

14.7 

15.8 

16.4 

15.2 

16.0 

16.1 

14.0 
1.8 



MFAN 
5.7 
8.5 

11.4 
0.7 
0.4 



S.D. 

4.6 

3.8 

4.3 

2.0 

1.8 



P* 
0.59 
0.66 
0.50 
0.55 
0.64 
0.3? 
0.44 
0.46 
0.48 
0.41 
0.49 
0.44 
0.31 
0.17 
0.20 
0.40 
0.28 
0.19 
0.32 
0.19 
0.26 

0.40 
0.15 



RBIS 

0.67 

0.69 

0.66 

0.65 

0.67 

0.53 

0.68 

0.61 

0.62 

0.52 

0.55 

0.42 

0.52 

0.53 

0.24 

0.52 

0.45 

0.28 

0.18 

0.19 

0.49 

0.51 
0.16 



DELTA 

12.1 

11.4 

13.0 

12.5 

11.5 

14.8 

13.6 

13.4 

13.2 

£3.9 

13.1 

13.6 

15.0 

16.8 

16.4 

14.0 

15.4 

16.5 

14.9 

16.5 

15.6 

14.1 
1.6 



MEAN 
5.3 
8.2 

11.9 
0.6 
0.2 



S.D. 

4.8 

3.9 

4.2 

1.9 

1.3 



0.70 
1679 
236434 



0.7? 
2094 
766877 



0.74 
2108 
216667 



20 L 



ERIC 



-171- 
D4 



MALE 



MSB 1980 SOPHOMORES 
REAOING 

FEMALE 



TOTAL 



P* RMS OFLTA P* RMS OELTA P* R8IS DELTA 



ITEM 
ITEM 
ITEM 
1TE" 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 10 
ITEM U 
ITEM 12 
ITEM 13 
ITEM 1* 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM 18 
ITEM 19 
1TM 20 

MEAN 

s.o. 

SUMMARY l 

MEAN S.O. 

FORMULA SCORE 6.7 4.7 

• RIGHT 9.0 3.9 

• WONG 9.3 3.8 

• OMITS 0.1 0.5 
I NOT REACHED 0.* 1.8 

COEFFICIENT ALPHA 0.77 
SAMPLE Si:£ 12100 
POPULATION ESTIMATE 1880855 



0.92 
0.7 A 
0.73 
0.61 
0.49 
0.44 
0.40 
0.16 
0.43 
0.32 
0.70 
0.49 
0.65 
0.35 
0.43 
0.27 
0.40 
0.22 
0.45 

0.49 
0.19 



0.59 
0.60 
0.61 
0.65 
0.54 
0.53 
0.65 
0.35 
0.53 
0.45 
0.66 
0.69 
0.68 
O.o6 
0.61 
0.50 
0.60 
0.37 
0.63 

0.57 
0.10 



7.5 
9.9 
10.5 
11.8 
13.1 
13.6 
U.O 
17.0 
13.7 
14.9 
10.9 
13.1 
11.5 
U.6 
13.7 
15.5 
U.O 
16.1 
13.6 

13.1 
2.2 



0.91 
0.79 
0.74 
0.54 
0.50 
0.43 
0.33 
0.16 
0.51 
0.29 
0.78 
0.47 
0.62 
0.33 
0.46 
0.30 
0.32 
0.19 
0.47 

0.48 
0.20 



0.56 
0.62 
0. 54 
0.63 
0. 60 
0.54 
0.61 
0.46 
0.59 
0.46 
0.57 
0.71 
0.64 
0.61 
0.67 
0.48 
0.61 
0.34 
0.62 

0.57 
0.08 



10, 

1 

1 

1 

1 

1 

1 

1 

10 

1 

1 

1 

1 

1 

1 

1 

1 



MEAN 
6.6 
9.0 
9.4 
0.1 
0.5 

0.76 
12706 
1885110 



S.O. 
4.7 
3.8 
3.8 
0.6 
1.6 



0.91 
0.78 
0.74 
0.58 
0.50 
0.44 
0.36 
0.16 
0.47 
0.30 
0.74 
0.48 
0.63 
0.34 
0.44 
0.29 
0.36 
0.21 
0.46 



0.57 
0.61 
0.58 
0.64 
0.57 
0.54 
0.63 
0.41 
0.55 
0.46 
0.61 
0.70 
0.66 
0.64 
0.64 
0.49 
0.60 
0.35 
0.63 



0.48 0.57 
0.20 0.09 



MEAN 
6.7 
9.0 
9.4 
0.1 
0.5 



S.O. 

4.7 

3.8 

3.8 

0.6 

1.7 



0.77 
24806 

3765965 



210 



-172- 
D5 



ITEM 1 
ITEM 2 
ITEM 3 
ITEM 5 
ITFM 6 
ITEM 7 
ITEM 8 
ITfcN 9 
ITEM 10 
ITEM 11 
ITFM 12 
ITEM 19 
ITEM 14 
ITEM 19 
ITEM 16 
ITEM 1? 
ITFM 18 
ITFM 19 
ITEM 20 

MEAN 
5.0. 

SUMMARY: 

FORMULA SCORE 
ff RIGHT 

# WRONG 

# omits 

# not reached 



HSB I960 SOPHOMORES 
READING 



WHITE 




RD1S 


OFLTA 


0.94 




6.7 


0.89 




9.2 


0.77 




10.0 


0.62 




11.7 


0.54 




12.6 


0.48 




19.9 


0.40 




14.0 


0.17 




16*9 


0.51 




12.9 


0.92 




14*8 


0.78 




9.9 


0.9* 




12.7 


0.66 




11.1 


0.98 




14.2 


0.49 




19.1 


0.91 




15.0 


0.40 




14.1 


0.21 




16.2 


0.51 




12.9 


0.52 




12.7 


0.?0 




2.4 



SLACK 




RA1S 


DELTA 


0*84 


0*52 




0*67 


0*55 


11.2 


0*65 


0*49 


11.4 


0*46 


0.59 


19*4 


0*38 


0.58 


14.2 


0*92 


0.47 


14*8 


0*26 


0.49 


19.6 


0*19 


0*95 


17.4 


0*36 


0.48 


14.4 


0*22 


0*97 


16.1 


0*62 


0.98 


11.7 


0.90 


0. 64 


19.1 


0.46 


0.60 


13.4 


0*21 


0*99 


16.2 


0*29 


0.99 


19.2 


0.29 


0*40 


16.0 


0.24 


0.99 


19*9 


0.16 


0.21 


17.0 


0.29 


0.97 


19*2 


0*37 


0.90 


14.4 


0.19 


0*11 





HISPANIC 



P* R91S OFLTA 

0*84 0*96 8.9 

0.64 0.57 11.6 

0*62 0*49 11*8 

0*45 0*96 13.9 

0*39 0*92 14.9 

0*33 0*49 14.8 

0*24 0.94 H.9 

0*14 0*18 17.4 

0*36 0*46 14*4 

0.?6 0.39 19.6 

0*60 0*96 12.0 

0*39 0*98 14.9 

0.49 0.98 13.1 

0*22 0*97 16*1 

0.31 0.92 19.0 

0.19 0*39 16.9 

0.26 0.90 19.6 

0.18 0.19 16.7 

0.31 0.99 19.0 

0.38 0*48 14.4 

0*18 0.12 2*0 



TOTAL 



R81S OFLTA 

0.91 0.97 7.9 

0.78 0.61 9.9 

0*74 0*98 10.9 

0.98 0.64 12.2 

0.90 0.97 13.0 

0.44 0.94 13.6 

0.36 0*63 14*4 

0.16 0.41 17.0 

0.47 0.99 13.3 

0.30 0.46 19.1 

0.74 0.61 10.9 

0.48 0.70 13.? 

0.63 0.66 11.6 

0.34 0.64 14*7 

0*44 0*64 13.6 

0.29 0.49 15*3 

0*36 0*60 14*4 

0*21 0.35 16.3 

0.46 0.63 13.4 

0.48 0.97 13.1 

0.20 0.09 2.3 



MEAN 


S.O. 


MEAN 


S.O. 


7.3 


4.7 


4.1 


3. 8 


9.7 


3.8 


6.8 


3. 2 


8.8 


3.7 


10.7 


3. 6 


0.1 


0.9 


0.2 


0. 9 


0.3 


1.3 


1.2 


2.7 



MEAN 


S.D. 


MEAN 


S.O. 


4.1 


3.9 


6.7 


4.7 


7.0 


3.2 


9.0 


3.8 


11.2 


3.4 


9.4 


3.6 


0.2 


0.7 


0.1 


0.6 


0.7 


2. 0 


0.9 


1.7 



COEFFICIENT AlPHA 0.76 
SAMPLF Sl/F 16877 
POPULATION ESTIMATE 2737044 



0.66 
3072 
452794 



0.64 
4* A 
484196 



0.77 
24906 
3769969 



HSR 1980 SOPHOMORES 
READING 



WHITE MALE 



WHITE FEMALE 



BLACK HALE 



BLACK FFMALE 



HISPANIC HALE 



HISPANIC FEMALE 



I 
2 
3 
5 
6 
7 
6 
9 
10 



ITEM 
ITEM 
ITEM 
I TEN 
ITEN 
I TEN 
ITEN 
ITEN 
I TEN 
ITEN 11 
ITEN 12 
I TEN 13 
I TEN 14 
ITEN 15 
ITEN 16 
I TEN 17 
ITEN 18 
ITEN 19 
ITEN 20 




ON 



NEAN 
S.D. 



0.52 
0.20 



0.58 
0.08 



12.7 
2.4 



0.52 
0.21 



0.57 
0.08 



12.7 
2.5 



0.38 
0.19 



0.51 
0.12 



14.3 
2.1 



0.17 
0.20 



0.49 
0.11 



14.4 

2.2 



0.38 
0.18 



0.49 
0.13 



14.3 

2.0 



0.37 
0.19 



0.48 
0.12 



14.4 
2.1 



SUNN ANY I 

FORMULA SCORE 

§ RIGHT 

* WRONG 

$ ONITS 

I NOT REACHED 



MEAN 
7.6 
9.8 
8.6 
0.1 
0.3 



S.D. 

4.7 

3.8 

3.8 

0.5 

1.4 



MEAN 
7.5 
9.7 
8.9 
0.1 
0.3 



S.D. 

4.6 

3.7 

3.7 

0.5 

1.3 



NFAH 
4.2 
A. 8 

10.7 
0.2 
1.3 



S.D. 

3.9 

3.3 

3.7 

0.9 

7.8 



MEAN 
4.0 
6.7 

10.8 
0.2 
1.2 



S.D. 

3.7 

3.1 

3.5 

0.9 

2.6 



MEAN 
4.3 
7.0 

11.1 
0.1 
0.7 



5.0. 

3.2 
3.4 

n.A 

2.0 



NEAN 
4.0 
6.8 

11.3 
0.2 
0.6 



S.O. 

3.7 

3.1 

3.3 

0.8 

2.0 



COEFFICIENT ALPHA 0.74 
SAMPLE SUE 8262 
POPULATION FSTIMATE 1349255 



9.76 
85*5 
1397789 



0.68 
1389 
215303 



0.64 
1683 
237491 



0.66 
2085 
266925 



0.63 
2106 
217268 



ERLC 



212 



213 



-174- 
D7 



MALE 

P* KBIS DELTA *♦ 



PART 


1 


ITEM 


1 


PART 


1 


ITEM 


2 


PART 


1 


ITEM 


3 


part 


1 


ITEM 


4 


PART 


1 


ITEM 


5 


PART 


1 


ITEM 


6 


PART 


1 


ITEM 


7 


PART 


1 


ITEM 


• 


PART 


1 


ITEM 


9 


par; 


1 


ITEM 


10 


PART 


1 


ITEM 


11 


PART 


1 


ITEM 


12 


PART 


1 


ITEM 


13 


PART 


1 


ITEM 


14 


PART 


1 


ITEM 


15 


PART 


1 


ITEM 


16 


PART 


1 


ITEM 


17 


PART 


1 


ITEM 


18 


PART 


1 


ITEM 


19 


PART 


1 


ITEM 


20 


PART 


1 


ITEM 


21 


PART 


1 


ITEM 


22 


PART 


1 


ITEM 


23 


PART 


1 


ITEM 


24 


PART 


1 


ITEM 


25 


PART 


1 


ITEM 


26 


PART 


1 


ITEM 


27 


PART 


1 


ITEM 


in 


PART 


2 


ITEM 


l 


PART 


2 


ITEM 


2 


PART 


2 


ITEh 


3 


PART 


7 


ITEM 


4 


PART 


2 


ITEM 


5 


PART 


2 


ITEM 


6 


PART 


2 


ITEM 


7 


PART 


2 


ITEM 


8 


PAR r 


2 


ITEM 


9 


**RT 


2 


ITEM 


10 



MEAN 
S.O. 

SUMMARY: 

FORMULA SCORE 
ft RIGHT 
# WRONG 
I OMITS 

I NOT RE AC HE 0 PI 
I NOT REACHED P? 



0.83 0.53 9.1 

0.78 0.45 9.9 

0.66 0.55 11.2 

0.7* 0.45 10.6 

0*61 0.73 11.8 

0*70 0.49 10.9 

0.59 0.72 12.1 

0.71 0.76 10*6 

0.66 0.50 11.3 

0*57 0.64 12.3 

0*46 0.47 13.4 

0*66 0.62 11.4 

0.47 0.68 13*3 

0.59 0.56 12. 1 

0.56 0*42 12*4 

0.47 0*70 13.3 

0.49 0*58 13.1 

0.39 0*53 14*2 

0.58 0*71 12.2 

0*45 0*69 13.5 

0.35 0.66 14*6 

0.43 0.67 13.7 

0.26 0.34 15*5 

0.26 0.57 15*6 

0.44 0.62 13.6 

0.25 0.7? 15.7 

0.34 0.55 14.7 

O.lt 0.*9 17.1 

0.49 0.16 13.1 

0.60 0.73 *2.0 

0.53 0.45 12.7 

0.71 0.48 10.0 

0.47 0.82 13.3 

0.24 0.55 15.8 

0.28 0.47 15.3 

0.48 0.55 13.2 

0.76 0.31 15.6 

0.33 0.35 14.8 

0.50 0.56 13.1 

0.17 0.14 1.8 



MFAN 


s.o. 


12.6 


10.2 


18.7 


7.8 


18.4 


7.7 


0.4 


1.4 


0.2 


1.6 


0.2 


1.1 



HSB 1980 SOPHOMORES 
MATHEMATICS 

FEMALE 

RBIS DELTA 

0.85 0.45 8.6 

0.75 0.39 10.4 

0.66 0.43 11.4 

0.72 0.39 10.7 

0.60 0.74 12.0 

0.67 0.44 11.3 

0.60 0.68 12.0 

0.76 0.75 10.2 

0.67 0.45 11.3 

0.44 0.64 12.6 

0.34 0.49 14.7 

0.64 0.58 11.5 

0.49 0.69 13.1 

0.58 0.59 12*2 

0.55 0.36 12.5 

0.54 0.69 12*6 

0.53 0.49 12.7 

0.33 0.42 14.8 

0.53 0.69 12.7 

0.47 0.62 13.3 

0.36 0.70 14.5 

0.39 0.66 14.1 

0.24 0.30 15.8 

0.22 0.45 16.0 

0.43 0.54 13.7 

0.19 0.65 16.6 

0.28 0.51 15.3 

0.12 0.19 17*7 

0.42 -0.02 13.8 

0.56 0.71 12.4 

0.57 0.42 12.3 

0.75 0.38 10.3 

0.48 0.79 13.2 

0.23 0.43 16.0 

0.27 0.46 15.5 

0.47 0.57 13.3 

0.21 0.24 16.2 

0.30 0.28 15.1 

0.48 0.51 13.2 

0.18 0.17 2.0 



MEAN S.O. 

11.9 9.2 

18.2 7.0 

19.0 7.0 

0.4 1*4 

0.2 1.2 

0.2 1.0 



TOTAL 



P* R81S DELTA 

0.84 0.49 9.0 

0.76 0.42 10.1 

0.67 0*49 11.3 

0.72 0.42 10.6 

0.61 0.73 11.9 

0.66 0.47 11.1 

0.59 0.70 12.1 

0.74 0.75 10.5 

0.66 0.48 11.3 

0.<5 0.64 12.5 

0.40 0.48 14.0 

0.65 0.60 11.5 

0.48 0.68 13.2 

0.48 0.57 12.2 

0.55 0.39 12.5 

0.50 0.68 13.0 

0.51 0.53 12.9 

0.36 0.48 14.5 

0.55 0.70 12.5 

0.46 0.65 13.4 

0.35 0.67 14.5 

0.41 0.67 13.9 

0.25 0.32 15.7 

0.24 0.52 15.8 

0.44 0.58 13.6 

0.22 0.69 16.1 

0.31 0.54 15.0 

0.14 0.31 17.3 

0.45 0.00 13.5 

0.58 0.72 12.2 

0.55 0.43 12.5 

0.73 0.43 10.6 

0.48 0.80 13.2 

0.24 0.49 15.9 

0.28 0.47 15.4 

0.47 0.56 13.3 

0.24 0.28 15.9 

0.31 0.32 14.9 

0.49 0.53 13.1 

0.17 0.15 1.9 



MEAN S.O. 

12.2 9.7 

18.5 7.4 

10.7 7.3 

0.4 1.4 

0.2 1.4 

0.2 1.1 



COEFFICIENT ALPHA 
SAMPLE SIZE 
POPULATION FSTlMATE 



O.fifl 
1874180 



0.85 
12699 
1883390 



0.87 
24782 
3757569 



-175- 



D8 



WHITE 



HS8 1980 SOPHOMORES 
MATHEMATICS 

BLACK 



HISPANIC 



TOTAL 



RBIS DELTA P4 RBIS OELTA P* 



PART 


1 


ITEM 


i 


A ■ » 


0*90 


PART 


I 


ITEM 


C 


A Tfl 

O. 7^ 


A A 9 


PART 


I 


I TEM 


j 


U. 1 I 


A ■ A 


PART 


I 


ITEM 


4 


A 7A 
U. ID 


A A A 


PART 


I 


ITEM 




a £. a 


A 79 


PART 


I 


ITEM 




A 79 


A AO 
U.47 


PART 


I 


ITEM 


y 


A A. A 


A 7A 
V* 7Q 


PART 


I 


ITEM 


§ 


U *DU 


A 7« 

U. 79 


PART 


I 


ITEM 


•> 


A. 71 




PART 


1 


ITEM 


to 


0*61 


0.63 


PART 


1 


ITFM 


u 


0.44 


0.46 


PART 


1 


ITEM 


12 


0*69 


UlDV 


PART 


1 


ITEM 


1) 


0*94 


0*69 


PART 


1 


ITEM 


14 


0.69 


0.92 


PART 


1 


I TEH 


}« 


0.98 


0*40 


PART 


1 


ITEM 


16 


0.5? 


0.69 


PART 


1 


ITEM 


17 


0.94 


0.99 


PART 


1 


ITEM 


18 


0.39 


0.47 


PART 


1 


ITFM 


19 


0.61 


0.69 


PART 


1 


ITEM 


20 


0.92 


0.64 


PART 


1 


ITEM 


21 


0.40 


0.66 


PART 


1 


ITEM 


22 


0*46 


0.66 


PART 


1 


ITEM 


23 


0.27 


0.31 


PART 


1 


ITEM 


24 


0.27 


0.91 


PART 


1 


ITFM 


29 


0*48 


0.98 


PART 


1 


ITEM 


26 


0.26 


0.68 


PART 


1 


ITEM 


27 


0.39 


0.93 


PART 


1 


ITEM 


28 


0*14 


0.41 


PART 


2 


ITEM 


1 


0*41 


0.18 


PART 


2 


ITEM 


2 


0*64 


0.70 


PART 


2 


ITEM 


3 


0*97 


0.48 


PART 


2 


ITU 


4 


0.T9 


0.44 


PART 


2 


ITFM 


9 


0.99 


0.78 


PART 


2 


ITEM 


6 


0*26 


0*49 


PART 


2 


ITEM 


7 


0.31 


0.49 


PART 


2 


ITEM 


8 


0.92 


0.96 


PART 


2 


ITEM 


9 


0*24 


0.30 


PART 


2 


ITEM 


10 


0.33 


0.31 


MEAN 






0.53 


0.93 


S.O. 






0.18 


0.14 



SUMMARY! 

MEAN 

FORMULA SCORE U.2 

■ RIGHT 20.0 

• WRONG l7 .3 
f OMITS 0.4 

• NOT REACHFO PI O.I 
i NOT REACHEO P2 0.1 

COEFFICIENT ALPHA 0.87 

SAMPLE SUF 16798 

Pnvi ii ati on FcrmArt ?7inQirt 



8.6 
9.8 
10.8 
10.1 
U.2 
10.7 
11.4 
9.6 
10.8 
11.9 
13.6 
11.0 
12.4 
11.4 
12.2 
12.9 
12.6 
14.1 
11.8 
12.8 
14.0 
13.4 
19.4 
19.4 
13.2 
19.6 
14.6 
17.4 
13.7 
11.9 
12.3 
10.3 
12.9 
19.6 
19.0 
12.8 
19.8 
14.7 

12.7 
2.0 



S.D. 
9.6 
7.3 
7.2 
1.4 
1.2 
1.0 



0.78 

0.69 

0.99 

0.60 

0.37 

0.97 

0.41 

0.93 

0.93 

0.39 

0. 24 

0.91 

0.29 

0.36 

0.46 

0.39 

0.43 

0.26 

0.33 

0.28 

0.19 

0.21 

0.18 

0.19 

0.29 

0.09 

0.16 

0. 16 

0.92 • 

0.36 

0.48 

0.66 

0.23 

0.16 

0.17 

0.30 

0.19 

0.29 



0.43 
0.39 
0.37 
0.33 
0.67 
0.28 
0.98 
0.67 
0.41 
0.93 
0.40 
0.91 
0.70 
0. 97 
0. SO 
0.61 
0.43 
0.41 
0.60 
0.99 
0.92 
0.49 
0.26 
0.49 
0.41 
0.44 
0.36 
0.03 
•0.17 
0.69 
0.23 
0.33 
0.76 
0.38 
0.38 
0.43 
0.19 
0.27 



9.9 
11.0 
12.9 
12.0 
14.3 
12.3 
13.9 
12.7 
12.7 
14.9 
19.8 
12.9 
19.2 
14.4 
13.4 
14.6 
13.7 
19.4 
14,8 

19.9 

16.9 

16.2 

16.6 

17.1 

19.2 

18.3 

16.9 

17.0 

12.8 

14.2 

13.2 

11.3 

19.9 

17.0 

16.9 

19.1 * 

16.4 

19.8 



0.36 0.42 14.6 
0.17 0.19 1.9 



MEAN 

9.9 
13.6 
23.1 

0.6 

0.9 

0.3 

0.76 
3068 
4*1 9*9 



s.o. 

7.2 
9.9 
9.9 
1.9 
2.1 
1.4 



0.77 

0.69 

0.96 

0.61 

0.43 

0.60 

0.42 

0.96 

0.94 

0.43 

0.33 

0.94 

0.33 

0.42 

0.48 

0.36 

0.42 

0.27 

0.41 

0.30 

0.23 

0.26 

0.22 

0.16 

0.30 

0.11 

0.22 

0.13 

0.48 • 

0.41 

0.90 

0.69 

0.29 

0.17 

0.19 

0.38 

0.22 

0.26 

0.39 
0.16 



0.40 
0.36 
0.39 
0.36 
0.43 
0.32 
0.99 
0.49 
0.41 
0.98 
0.41 
0.93 
0.64 
0.96 
0.30 
9.99 
0.44 
0.49 
0.62 
0.96 
0.60 
0.93 
0.27 
0.43 
0.46 
0.99 
0.38 
0.08 
-0.11 
0.66 
0.29 
0.41 
0.73 
0.39 
0.3* 
0.43 
0.19 
0.26 

0.44 
0.17 



OELTA 


P* 


RMS 


OELTA 


10.0 


0.84 


0.4% 


9.0 


11.0 


0.76 


0.42 


10.1 


12.4 


0.67 


0.49 


11.3 


11.9 


0.72 


0.42 


10.6 


13.7 


0.61 


0.73 


11.9 


12.0 


0.68 


0.47 


11.1 


13.8 


0.49 


0.70 


12.1 


12.4 


0. 74 


0.79 


10.9 


12.6 


0.66 


0.46 


11.3 


13.8 


0.99 


0.64 


12.9 


14.8 


0.40 


0.48 


14.0 


12.6 


A AC 


0.60 


11.9 


14.8 


0.48 


0.68 


13.2 


13.8 


0.98 


0.97 


12.2 


13.2 


0.99 


0.39 


12.9 


14.4 


0.90 


0.68 


13.0 


13.8 


0.91 


0.93 


12.9 


19.9 


0.36 


0.48 


14.9 


14.0 


0.99 


0.70 


12.9 


19.2 


0.46 


0.69 


13.4 


19.9 


0.39 


0.67 


14.9 


19.3 


0.41 


0*67 


13.9 


16.2 


0.29 


0.32 


19.7 


17.0 


0.24 


0.92 


19.8 


19.1 


0.44 


0.98 


13.6 


17.8 


0.22 


0.69 


16.1 


16.1 


0.31 


0.94 


19.0 


17.6 


0.14 


0.31 


17.3 


13.2 


0.49 


0.08 


13.9 


13.9 


0.90 


0.72 


12.2 


13.0 


0.99 


0.43 


12.9 


11.9 


0.73 


0.43 


10.6 


19.3 


0.48 


0.80 


13.2 


16.9 


0.24 


0.49 


19.9 


16.6 


0.28 


0.47 


19.4 


14.2 


0.47 


0.94 


13.3 


16.1 


0.24 


0.28 


19.9 


19.6 


0.31 


0.32 


14.9 


14.3 


0.49 


0.93 


13.1 


1.8 


0.17 


0.19 


1.9 



MEAN 

7.0 
14.9 
22.9 

0.9 

0.2 

0.2 

0.79 
4206 

4A4?*f 



S.O. 
7.8 
9.9 
6.1 
1.4 
1.6 
1.3 



MEAN 
12.2 
18.9 
18.7 

0.4 

0.2 

0.2 

0.87 
2478? 



S.O. 
9.7 
7.4 
7.3 
1.4 
1.4 
1.1 



ERLC 



2VC 



ms* i4io snNmfs 

4ATMFRATICS 



WHITE NtF 



WHITE MMl! 



HICK NAIF 



IlKK FEN*.,.* 



M15MN1C *AlE 



kismnic te*ue 



mkt 
pmt 

KMT 
MKT 
MKT 
MKT 
MKT 
MKT 
FMT 
MKT 
MKT 
MKT 
MKT 

fmt 
pmt 

MKT 
KMT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
MKT 
PMT 
KMT 
KMT 
KMT 
KMT 
KMT 
KMT 



I ITfK I 

i I Ten 2 

I ITEK 3 

I ITCK 4 

I I Ten 9 

I ITf* 4 

i iieK ? 

I ITCK • 
I ITfK 4 
ITFK 10 
I Ten It 
ITfK 12 
ITEK II 
ITCK 14 
ITfK 15 

in* t4 

ITCH IT 
ITJfK II 
!Tf4 |4 
ITfK 20 
I ITFK 21 
I ITFK 22 
I ITCK 23 
t ITCK 24 
I ITFK 29 
1 ITCK 24 
I ITFK 2T 

1 ITF" 21 

2 ITCK I 
ITFK 
ITCK 
ITFK 
ITFK 
ITCK 
ITFK 
ITCK 
ITFK 



ITFK 10 



K4 
0.4* 

o.ri 
o.n 

0. TT 
0*44 

1. T4 
0.4* 
O.TI 
O.TI 
0.49 
0.91 
O.TO 
0*9) 
0*44 
0*94 
0.91 
0.92 
0*49 
0.44 
0.91 
0.94 
0.41 
0*24 
0.24 
0.44 
0.90 
0.94 
0.14 
0*40 
0*44 
0*99 
0.T4 
0.94 
0.2T 
0*91 
0.92 
0.2? 
0.94 



KKIS 
0.94 
0*44 
0.94 
0.49 
0.T9 
0.51 

o.n 

0.T4 
0.41 
0.«4 
0*44 
0.42 
0*44 
0.91 
0.4) 
O.TI 
0.40 
0.92 
O.TO 
0.4? 
0.49 
0.4? 
0.99 
0*9? 
0.49 
O.TI 
0.99 
0.44 
0. 24 
0.T2 
0.90 
0.44 
0.40 
0.94 
0.44 
0.9T 
0.11 
0.99 



OCIT4 
4.T 
4.4 
10.4 
10.0 

II. I 

10*9 
11.4 
9.4 
10.4 

11. T 
12.4 
10.4 

12. ? 
11.4 
12.1 
12.4 
1 2.F 
19.? 
11.4 
12.4 
14.1 
19.2 
19.1 
19.2 
19.1 
19.1 
14.2 
I T.I 
19.2 
II.) 
12.9 
10.9 
12.4 
19.4 
19.0 
12.4 
19.4 
14.9 



KKIS 
0.49 
0,14 
0.4* 
0.94 
0.T2 
0.4? 
0.4? 
0.T9 
0.49 
0.49 
0.44 
0.44 
0.49 
0.4) 
0.94 
0.44 
0.41 
0.41 
0.44 
0.40 
0.44 
0.49 
0.24 
0.44 
0.94 
0.49 
0.91 
0.30 
0.04 
0.44 
0.44 
0.94 
0.T4 
0.42 
0.44 
0.94 
0.24 
0.24 



oei?4 

F.4 
10. 1 
II. 1 
10.9 
11.2 
10.4 
11.4 

4.) 

id.? 

12.1 
14.) 
II. 1 
12.9 
11.9 
12.9 
12.1 
12.4 
14.9 
12.1 
12.4 
19.4 
19.4 
19.4 
19.? 
19.2 
14.1 
14.4 
l?.l 
t4.| 
ll.T 
12.1 
10.0 
12.4 
19.? 
19.0 
12.4 
14.1 
19.0 



K4 
0.?4 
O.TI 
4.9) 
0.40 
0.4« 
0.44 
0.99 
0.44 
0.94 
0.94 
0.2? 
0.44 
0.2T 
0.44 
0.44 
0.91 
0.94 
0.24 
0.94 
0*21 
0.14 
0.22 
0.14 
0.14 
0.90 
O.tO 
0.14 
0.1* 
0.99 
0.40 
0.*9 
0.49 
0.29 
0.14 
0.14 
0.49 
0.14 
0.29 



MIS 
0*44 
0.41 
0.44 
0.94 
0.4? 
0.99 

0. 40 

1. TO 
0.44 
0.44 
0.94 
0.90 
0.44 
0.94 
0.24 
0.40 
0.44 
0.44 
0.41 
0.94 
0.94 
0.90 
0.29 
0.44 
0.44 
0.4? 
0.99 

-0.02 
-0.14 
0.44 
0.24 
0.4t 
O.TI 
0.94 
0.31 
0.9? 
O.ll 
0.90 



K4 
0.?l 
0.4? 
0.91 
0.40 
0.44 
0.99 
0.42 
0.94 
0.91 
0.49 
0.22 
0.99 
0.91 
0.94 
0.4? 
0.44 
0.4? 
0.24 
0.91 
0.24 
0.14 
0.21 

o.n 

0.i9 
0.24 
0.06 
0.19 
0.14 
0.90 
0.94 
0.90 
0.44 
0.24 
0.14 
0.19 
0.24 
0.20 
0.24 



MIS 
0.42 
0.9? 
0.29 
9.92 
0.4? 
0.24 
0.9? 
0.44 
0.94 
0.90 
0.44 
0.92 
0.?l 
0.40 
0.41 
0.49 
0.91 
0.94 
0.99 
0.94 
0.91 
0.44 
0.2? 
0.44 
0.94 
0.44 
0.99 
-0.04 
•0.21 
0.49 
0.22 
0*24 
0.?4 
0.9? 
0.94 
0.40 
0.19 
0.24 



OFl 



KF4K 




0.94 0. 


54 12.4 


0.92 0.91 


12.1 


0.94 0.44 


14.4 


0.94 0.41 


14.4 


0.94 0.49 


14.2 


0.94 0.42 


14. 


S.O. 




0.1? 0* 


19 1.4 


0.14 0.14 


2.1 


0.1? 0.14 




0.14 0.14 


2.0 


0.14 0.14 


1.4 


O.t? 0.19 


I* 


SUNNAfVt 
































MEAN 


$•0. 


Mf AM 


4.0. 


AN 


s.n. 


HF AN 


S.O. 


NF4N 


4.0. 


Rf AN 


$•0. 


FOR KtH A SCORE 




14.? 


10. 1 


19.? 


4.0 


4.4 


?.5 


5.4 


4.9 


?.4 


R.I 


4.9 


T.4 


• RICH? 




20.4 


?•? 


14.4 


4.4 


11.9 


4.? 


11.4 


9.9 


14.4 


4.2 


14.2 


9.4 


$ MR INK} 




14.4 


r.4 


1?.? 


4.4 


21.0 


4.1 


29.1 


9.T 


22.9 


4.1 


22.4 


9.4 


0 0MI?S 




0.4 


1.4 


0.4 


1.4 


0.4 


1.4 


0.4 


1.4 


0.4 


1.2 


0.9 


1.9 


0 40? RFttHEO 


Fl 


0.2 


1.4 


0.1 


1.0 


0.9 


2.2 


0.4 


2.0 


0.2 


1.4 


0.2 


1.4 


# NOT RFKHFO 


42 


0.2 


I.I 


0.1 


0.9 


0.4 


1.9 


0.4 


1.4 


0.2 


1.1 


0.2 


1.4 



K4 
O.T? 
O.TO 
0.99 
0.41 
0.44 
0.40 
0.49 
0.99 
0.99 
0.44 
0.11 
0.99 
0.99 
0.44 
0.49 
0.99 
0.42 
0.24 
0.44 
0.2? 
0.24 
0.92 
0.22 
0.1? 
0.29 
0.19 
0.24 
0.19 
0.41 
0.44 
0.44 
0.42 
0.29 
0.1? 
0.19 
0.99 
0.29 
0.24 



KRIS 
0.49 
0.94 
0.4A 
0.14 
0.41 
0.34 
0.94 
0.44 
0.49 
0.44 
0.41 
0.94 
0.44 
0.94 
0.90 
0.94 
0.49 
0.49 
0.49 
0.41 
0.91 
0o99 
0.90 
0.91 
0.90 
0.49 
0.99 
0.19 
>0.0I 
0.44 
0.92 
0.4? 
0.?9 
0.1* 
0.40 
0.41 
0.14 
0.24 



0FIT4 

10.1 

10.4 

12.9 

It. 9 

19.4 

12.0 

19.? 

12.5 

12.9 

19.4 

14.2 

12.4 

14.? 

11.4 

19.1 

14.4 

19.1 

19.9 

19.4 

19.4 

19.4 

14.4 

14.0 

14.T 

19.2 

l?.4 

19.4 

1?.4 

19.2 

19.4 

19.1 

II. K 

19.2 

14.4 

14.5 

14.1 

19.4 

19.4 



K4 
0.?R 
0*44 
0.9? 
0.41 
0*40 
0.99 
0.42 
0.9? 
0.99 
0.40 
0.24 
0.92 
0.99 
0.94 
0.4? 
0.9? 
0.49 
0.24 
0.94 
0.92 
0.22 
0.24 
0.21 
0. 14 
0.91 
0.09 
0. 19 
0.19 
0.4? 
0.91 
0.42 
0.44 
0.21 
0.14 
0.1? 
0.94 
0.20 
0.24 



KRI4 
0.14 
0.14 
0.24 
0.4? 
0.44 
0.29 
0.99 
0.?l 
0.94 
0.40 
0.40 
0.42 
0.?0 
0.94 
0.90 
0.42 
0.49 
0.40 
0.42 
0.91 
0.42 
0.99 
0.24 
0.24 
0.41 
0.92 
0.34 
-0.01 
-0.14 
0.4) 
0.24 
0.12 
0.?2 
0.11 
0.94 
0.44 
0.14 
0.22 



0FIT4 
4.9 
11*2 
12.9 
11.9 
14.0 
12.1 
|4.# 
12.9 
I2.T 
14.1 
14.4 
12.1 
I4.R 
14.2 
19.9 
14.9 
I9.T 
14.4 
14.4 
14.1 
14.1 
19.1 
14.9 
IT.2 
19.0 
11.4 
14.4 
l?.4 
19.9 
14.9 
12.4 
11.2 
19.9 
14.4 
14.T 
14.4 
14.4 
19.4 



COEFFICIENT AlFMA O.R4 
44NKIE SUE 1244 
FORMATION FSTIK4TF 1144 Til 



0.49 
49*0 
1944220 



0.?4 
1944 
219921 



f>.?4 
l*H 
24??44 



0.40 
2040 
24*044 



0.?4 
2114 

»t?M? 



ERIC 



2J6 
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Dlu 



MAI E 



HSR 1980 SOPHOMORES 
SCIENCE 

FEMALE 



ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 8 
ITEM 9 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM 1* 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM 18 
ITEM 19 
ITEM 20 

MEAN 
S.O. 

SUMMARY: 



0.83 
0*74 
0.68 
0.78 
0.81 
0.85 
0.S3 
0.80 
0.67 
0.72 
0.63 
0.49 
0.53 
0.25 
0.50 
0.35 
0.48 
0.34 
0.29 
0.21 

0.57 
0.20 



TOTAL 



R8IS OELTA R6IS OELTA RBIS OELTA 



0.67 
0.47 
0.72 
0.63 
0.79 
0.58 
0.52 
0.77 
0.7? 
0.40 
0.59 
0.64 
0.70 
0.41 
0.40 
0.53 
0.66 
0.36 
0.48 
0.22 

0.56 
0.15 



FORMULA SCORE 

• RIGHT 
i WRONG 

• OMITS 

i NOT REACHED 

COEFFICIENT ALPHA 
SAMPLE SIZE 
POPULATION ESTIMATE 



9.2 
10.4 
11.1 
10.0 

9.6 

8.9 
12.7 

9.7 
11.2 
10. T 
11.7 
13.1 
12.7 
15. T 
13.0 
14.5 
13.2 
14.7 
15.? 
16.. 

12.2 
2.2 



MEAN 

9.3 
11.3 

8.0 

0.2 

0.4 

0.76 
11979 
18599 1 **) 



S.O. 
4.7 
3.8 
3.8 
0.8 
1.5 



0.82 
0.73 
0.T1 
0.67 
0.73 
0.83 
0.53 
0. 72 
0.53 
0.66 
0.45 
0.46 
0.54 
0.21 
0.39 
0.39 
0.44 
0.30 
0.24 
0.23 

0.53 
0.19 



0.60 
0.51 
0.60 
0.55 
0.73 
0.52 
0.54 
0.60 
0. 70 
0.42 
0.51 
0.59 
0.64 
0.40 
0.24 
0.45 
0.61 
0.40 
0. 36 
0.18 

0.51 
0.14 



MEAN 
8.3 

10.5 
8.9 
0.2 
0.4 



9.3 
10.5 
10.8 
11.2 
10.5 

9.1 
12.7 
10.6 
12.7 
11.4 
13.5 
13.4 
12.6 
16.3 
14.1 
14.1 
13.6 
15.1 
15.8 
16.0 

12.7 
2.1 



S.O. 

4.4 

3.6 

3.6 

0.9 

1.3 



0.82 
0.74 
0.70 
0.73 
0.77 
0.84 
0.53 
0.76 
0.60 
0.69 
0.54 
0.47 
0.53 
0.23 
0.45 
0.37 
0.46 
0.32 
0.27 
0.?2 

0.55 
0.20 



0.63 
0.49 
0.65 
0.60 
0.76 
0.55 
0.53 
0.68 
0.72 
0.41 
0.56 
0.61 
0.66 
0.41 
0.34 
0.48 
0.63 
0.38 
0.43 
0.19 

0.'j4 
0.14 



9.3 
10.4 
10.9 
10.6 
10.1 

9.0 
12.7 
10.2 
12.0 
11.0 
12.6 
13.1 
12.7 
16.0 
13.5 
14.3 
13.4 
14.9 
15.5 
16.1 

12.4 

2.1 



0.71 
17568 
18A27G9 



MEAN 

8.8 
10.9 

8.5 

0.2 

0.4 

0.74 
24547 
3722708 



S.O. 
4.6 
3.7 
3.7 
0.8 
1.4 
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-178- 
Dll 



WHITE 



MSB 1910 SOPHOMORES 
SCIENCE 

BLACK 



HISPANIC 



TOT At 



1 
2 
3 
4 
5 
6 
7 
S 
9 
10 
11 
12 



ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 13 
ITEM 14 
ITEM 13 
ITEM 14 
ITEM 17 
ITEM 18 
ITEM 19 
ITEM 20 

MEAN 
S.O. 

SUMMARY! 

MEAN S.O. 

FOUNUIA SCORE 9.9 4.2 

f MIGHT 11. 8 9.4 

I WRONG 7.7 3.4 

f OMITS 0.2 0.8 

i NOT ftEACHEO 0.3 1.1 

COEFFICIENT ALPHA 0.69 
SAMPLE SIZE 16692 
POPULATION ESTIMATE 2710220 



P4 

0.87 
0.78 
0.75 
0.77 
0.85 
0.88 
0.58 
0.81 
0.69 
0.72 
0.59 
0.52 
0.60 
0.25 
0.46 
0.41 
0.51 
0.34 
0.29 
0.22 

0.59 
0.21 



MIS OELTA 88 IS OEITA P* 881S OEITA P* MIS OELTA 



0.56 
0.42 
0.62 
0.59 
0.72 
0.49 
0.49 
0.67 
0.67 
0.37 
0.54 
0.62 
0.65 
0.42 
0.38 
0.46 
0.61 
0.41 
0.47 
0.23 

0.52 
0.12 



8.6 
9.9 
10.3 
10.1 
8.9 
6.4 
12.2 
9.5 
11.0 
10.7 
12.1 
12.6 
12.0 
15.7 
13.4 
13.9 
12.9 
14.7 
15.2 
16.1 

11.9 
2.4 



0.71 
0.56 
0.54 
0.56 
0.47 
0.73 
0.30 
0.59 
0.25 
0.56 
0.35 
0.34 
0.34 
0.17 
0.42 
0.26 
0.27 
0.25 
0.19 
0.23 



0.61 
0.50 
0.60 
0.53 
0.62 
0.52 
0.46 
0.57 
0.63 
0.43 
0.46 
0.47 
0.61 
0.35 
0.23 
0.44 
0.57 
0.29 
0.24 
0.11 



0.41 0.46 
0.17 0.14 



MEAN 
5.2 
7.9 

10.8 
0.3 
1.1 



10.7 
12.2 
12.6 
12.2 
13.3 
10.5 
15.1 
12.1 
15.6 
12.4 
14.6 
14.7 
14.6 
16.9 
13.6 
15.6 
15.4 
15.7 
16.5 
15.9 

14.0 
1.9 



S.O. 

4.0 

3.3 

3.7 

0.9 

2.3 



0.71 
0.64 
0.53 
0.62 
0.60 
0.74 
0.41 
0.62 
0.42 
0.63 
0.43 
0.34 
0.36 
0.17 
0.43 
0.26 
0.31 
0.26 
0.21 
0.22 

0.45 
0.17 



0.59 
0.49 
0.62 
0.52 
0.69 
0.50 
0.45 
0.42 
0.65 
0.46 
0.51 
0.51 
0.57 
0.35 
0.30 
0.45 
0.61 
0.27 
0.27 
0,22 

0.46 
0.14 



MEAN 
6.2 
8.8 

10.4 
0.2 
0.5 



10.8 
11.6 
12.7 
11.7 
12.0 
10.4 
13.9 
11.8 
13.8 
11.7 
13.7 
14.7 
14.4 
16.8 
13.7 
15.5 
15.0 
15.3 
16.3 
16.1 

13.6 
1.9 



S.O. 

4.3 

3.5 

3.6 

0.9 

1.7 



0.62 
0.74 
0.70 
0.73 
0.77 
0.64 
0.53 
0.76 
0.60 
0.69 
0.54 
0.47 
0.53 
0.23 
0.45 
0.37 
0.46 
0.32 
0.27 
0.22 

0.55 
0.20 



0.63 
0.49 
0.65 
0.60 
0.76 
0.55 
0.53 
0.68 
0.72 
0.41 
0.56 
0.61 
0.66 
0.41 
0.34 
0.46 
0.63 
0.36 
0.43 
0.19 

0.54 
0.14 



MF2.N 
6.6 

10.9 
6.5 
0.2 
0.4 



9.9 
10.4 
10.9 
10.6 
10.1 

9.0 
12.7 
10.2 
12.0 
11.0 
12.6 
13.3 
12.7 
16.0 
13.9 
14.3 
13.4 
14.9 
15.9 
16.1 

12.4 
2.1 



S.O. 

4.6 

3.7 

3.7 

0.6 

1.4 



0.64 
2994 
443451 



0.68 
4157 
4TRT71 



0.74 
24>47 
3722708 
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HSB 1980 SOPHnMORFS 
SCIENCE 



WHITE MALE 



WHITE FEMALE 



BLACK MALE 



BLACK FEMALE 



HISPANIC HALF 



HISPANIC FFMALF 



ITEM 1 
ITEM 2 
ITEM 3 
I TEN 4 
ITEM 5 
ITEM 6 
ITEM 7 
ITEM 8 
ITEM 9 
ITEM 10 
ITEM U 
IT€M 12 

item n 

ITEM 14 
ITEM 15 
ITEM 16 
ITEM 17 
ITEM 18 
ITEM 19 
ITFM 20 

MEAN 
S.D. 

SUMMARY: 

FORMULA SCORE 

I RIGHT 

I WRONG 

f OMITS 

J NOT RFACHEO 

COEFFICIENT ALPHA 
SAMPLE SIZt 
POPULATION ESTIMATE 



P* 
0.67 
0.78 
0. 75 
0.61 
0.69 
0.66 
0.5ft 
0.85 
0. 76 
0.75 
0.69 
0.5* 
0.59 
0.27 
0.5? 
0. 39 
0.5* 
0.35 
0.32 
0.22 

0.62 
0.21 



RBIS 
0.63 
0.41 
0.70 
0.64 
0.75 
0.54 
0.49 
0.77 
0.68 
0.35 
0.54 
0.6* 
0.6* 
0.41 
0.44 
0.52 
0.63 
0.39 
0.52 
0.2* 

0.55 
0. i* 



DELTA 
8.5 
9.9 

10.3 
9.* 
A. 2 
8.3 

12.2 
6.8 

10.1 

10.3 

11.0 

12.6 

12.1 

15.4 

12.6 

U.l 

12.6 

14.5 

U.fl 

16.2 

11.6 
2.4 



MEAN 
10.* 
12.2 

7.3 

0.2 

0.3 

0.72 
8201 
1336555 



S.O. 
4. 3 
3.5 
3.5 
0.7 
1.2 



P* 
0.A6 
0.79 
0.76 
0.7Z 
0.82 
0.87 
0.59 
0.77 
0.62 
0.69 
0.*9 
0.50 
0.60 
0.22 
0.39 
0.*3 
0.46 
0.32 
0.25 
0.23 

0.5T 
0.21 



RBIS 
0.55 
0.44 
0.55 
0.5* 
0.68 
0.*6 
0.50 
0.5* 
0.65 
0.37 
0.5! 
0.60 
0.62 
0.42 
0.29 
0.*3 
0.58 
0.*3 
0.39 
0.2? 

0.*9 
0. 12 



DELTA 
8.6 
9.8 
10.2 
10. 7 
9.4 
8.4 
12.1 
10.0 
11.8 
11.0 
13.1 
13.0 
12.0 
16.0 
14.1 
13.7 
13.2 
U.fl 
15.6 
16.0 

12.2 
2.3 



MFAN 

9. 3 
11.3 

8.2 

0.2 

0.3 

0.6* 
8*91 
1373665 



S.O. 
'♦. I 
3.3 
3.3 
0.9 
1.0 



P* 
0.72 
0.63 
0.52 
0.65 
0.52 
0.77 
0.33 
0.61 
0.32 
0.60 
0.41 
0.3* 
0.3* 
0. Ifl 
0.*5 
0.25 
0.27 
0.29 
0.20 
0.21 

0.*3 
0. 18 



RBIS 

0.65 

0.*9 

0.65 

0.54 

0.64 

0.54 

0.4? 

0.64 

0.65 

0. *l 

0.5S 

0.50 

0.63 

0.32 

0.29 

0.51 

0.63 

0.31 

0.2* 

0.1* 

0.49 
0. 15 



HELTA 

10.6 

11.7 

12. fl 

11.5 

12.8 

10.0 

I*. 8 

11.6 

14.9 

12.0 

13.9 

1*.6 

I * .6 

16.6 

13.5 

15.8 

15.* 

15.3 

16.4 

16.2 

13.7 
1.9 



MFAN 
*>.8 
fl.3 

10.2 
0.3 
1.1 



S.D. 

*. 2 

3.5 

3.8 

0.9 

2.3 



P* 
0.70 
0.5* 
0.56 
0.52 
0.*2 

0.28 
0.56 
0.20 
0.53 
0.2R 
0.33 
9.3* 
0.15 
0.39 
0.27 
0.27 
0.22 
0.19 
0 25 

0.38 
0.17 



RBIS 
0.57 
0.50 
0.58 
0.51 
0.59 
0.*9 
0.*9 
0.*9 
0.57 
0.** 
0.36 
0.*5 
0.60 
0.37 
0. |« 
0.39 
0.53 
0.25 
0.23 
0.10 

0.43 
0.15 



DELTA 

10.9 

12.6 

12.* 

12.8 

13.8 

10.9 

15.* 

1?.* 

16.4 

12.7 

15.3 

I*. 8 

1*.6 

17.1 

14.1 

15.5 

15.5 

16.1 

16.5 

15. fl 

14.3 
1.8 



MFAN 
*.6 
7.* 

11.3 
0.3 
1.0 



S.O. 

3.7 

3.0 

3.5 

1.0 

2.2 



P* 
0.72 
0.65 
0.51 
0.68 
0.65 
0.75 
0.43 
0.65 
0.50 
0.67 
0.50 
0.35 
0.35 
0. 1« 
0.45 
0.2* 
0.32 
0.31 
0.21 
0.20 

0.*7 
0.19 



RBIS 
0.61 
0.50 
0.66 
0.56 
0.72 
0.55 
0.*5 
0.70 
0.6* 
0.45 
0.56 
0.53 
0.61 
0.3A 
0.3* 
0.49 
0.t>2 
0.2* 
0.2R 
0.23 

0.51 
0.14 



DELTA 

10.7 

11.5 

12.9 

11.1 

11.* 

10.3 

13.7 

11.5 

13.0 

11.2 

13.0 

14.6 

1*.6 

16.6 

13.6 

15.8 

U.fl 

15.0 

16.3 

16.4 

13.* 
2.0 



MFAN 
6.7 
o.2 

10.1 
0.2 
0.5 



s.n. 

*.5 
3.6 
3.7 
1.0 
1.7 



P* 
0.69 
0.62 
0.56 
0.55 
0.53 
0.72 
0.*0 
0.58 
0.32 
0.57 
0.35 
0.33 
0.37 
0. 16 
0.*l 
0.29 
0.29 
0.25 
0.21 
0.25 

0.*? 
0.16 



RBIS 
0.57 
0.*9 
0.61 
0.*6 
0.6* 
0.4* 
0.45 
0.51 
0.64 
0.*6 
0.40 
0.49 
0.55 
0.30 
0.23 
0.4* 
0.60 
0.30 
0.25 
0.23 

0.*5 
0.13 



DELTA 

11. 0 
11.7 

12. * 
12.5 
12.7 
10.6 
U.l 
12.2 
«4.9 
12.3 
U.6 
U.8 
U.3 
17.0 
l*.0 
15.2 
15.3 
15.7 
16.2 
15.8 

13.9 
1.8 



MFAN 
5.6 
A. 3 

10.9 
0.3 
0.6 



S.D. 

4.0 

3.3 

3.4 

0.9 

1.7 



0.6A 
1354 
210700 



0.5fl 
1640 
232750 



0.71 
2067 
26*213 



0.63 
2090 
214559 



ERLC 



219 



220 



-180- 



D13 



i 

2 
3 
4 
9 
6 
7 
• 
9 



MALE 



HS» 1*80 SOPHOMORES 
WRITING 

FFNALE 



TOTAL 



MIS OELTA ?♦ MIS OELTA P* RRIS OELTA 



ITEM 
ITEM 
ITEM 
ITEM 
ITFM 
ITEM 
|TFN 
HEM 
ITEM 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM IS 
ITFN 14 
ITEM 19 
ITEM 16 
ITEM 17 

MEAN 
S.O. 

SUMMARY! 

MEAN S.O. 

FORMULA SCORE 6.* 9.1 

0 RIGHT 9.2 4.0 

• WRONG 7.0 3.9 

• OMITS 0.2 0.7 

• NOT REACHEO 0.9 1.6 

COEFFICIENT A1PHA 0.79 
SAMFLE SUE 11076 
POPULATION ESTIMATE 1840144 



0.63 
0.45 
0.61 
0.92 
0.31 
0.68 
0.60 
0.98 
0.78 
0.49 
0.67 
0.39 
0.42 
0.62 
0.94 
0.69 
0.67 

0.96 
0.13 



0.67 
0.64 
0.69 
0.63 
0.47 
0.96 
0.97 
0.44 
0.93 
0.62 
0.79 
0.94 
0.69 
0.79 
0.69 
0.68 
0.64 

0.61 
0*08 



11.7 
13.5 
11.9 
12.8 
14.* 
11.1 
12.0 
12.2 
9.9 
13.9 
11.3 
14.6 
13.8 
11.8 
12.6 
11.4 
11.2 

12.4 
1.3 



0.77 
0.60 
0.80 
0.63 
0.40 
0.77 
0.68 
0.69 
0.84 
0.98 
0.78 
0.43 
0.91 
0.79 
0.68 
0.76 
0.77 

0.67 
0.13 



0.68 

0.67 
0.71 
0.66 
0.96 
0.99 
0.99 
0.40 
0.90 
0.62 
0.76 
0.93 
0.64 
0.74 
0.69 
0.68 
0.69 

0.62 
0.09 



MEAN 
9.4 

11.1 
9.3 
0.2 
0.4 



10.0 
11.9 

9.7 
11.7 
14.0 
10.1 
11.1 
11.9 

9.1 
12.1 

9.9 
13.7 
12.9 
10.3 
11.1 
10.1 
10.0 

11.1 
1.4 



S.O. 
4.8 
3.7 
3.4 

0. ? 

1. :> 



0.70 
0.93 
0.70 
0.98 
0.36 
0.72 
0.64 
0.62 
0.81 
0.92 
0.72 
0.38 
0.47 
0.69 
0.61 
0.71 
0.72 

0.62 
0.11 



0.69 
0.67 
0.72 
0.69 
0.92 
0.97 
0.99 
0.43 
0.92 
0.63 
0.76 
0.94 
0.64 
0.79 
0.48 
0.69 
0.66 

0.63 
0.09 



MEAN 
8.1 

10.2 
6.2 
0.2 
0.4 



10.9 
12.7 
10.9 
12.2 
14.4 
10.6 
11.6 
11.6 
9.9 
12.6 
10.6 
14.2 
13.3 
11.0 
11.9 
10.8 
10.4 

11.8 
1.9 



S.O. 

9.1 

4.0 

3.6 

0.7 

1.4 



0.78 
12443 
1642131 



0.60 
24319 
3462979 



ERLC 
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MSB 1*80 SOPHOMORES 
WRITING 









WHITE 






BLACK 








»♦ 


MIS 


DELTA 


M 


MIS 


DELTA 


ITEM 


1 


0.75 


0.67 


10.5 


0.55 


0.66 


12.5 


ITEM 


2 


0.55 


0.66 


12.2 


0.56 


0.62 


14.4 


ITEM 


5 


0.75 


0.75 


10.5 


0.59 


0.64 


12.1 


ITEM 


4 


0.62 


0.66 


11.8 


0.45 


0.58 


15.7 


ITEM 


9 


0.59 


0.55 


14.1 


0.26 


0.42 


15.6 


ITEM 


* 


0.76 


0.57 


10.2 


0.65 


0.47 


11.7 


ITEM 




0.66 


0.60 


11.1 


0.52 


0.50 


12.8 


ITEM 


• 


0.65 


0.41 


11.5 


0.51 


0.54 


12.9 


ITEM 


9 


0.04 


0.50 


9.0 


0.75 


0.47 


10.4 


ITEM 


10 


0.57 


0.62 


12.5 


0.57 


0.56 


14.4 


ITEM 


11 


0.78 


0.7* 


9.9 


0.56 


0.66 


12.4 


ITEM 


12 


0.41 


0.55 


14.0 


0.50 


0.50 


15.0 


ITEM 


19 


0.52 


0.64 


12.8 


0.50 


0.49 


15.1 


ITEM 


14 


0.75 


0.74 


10.4 


0.49 


0.69 


15.1 


ITEM 


15 


0.66 


0.68 


11.5 


0.42 


0.54 


15.8 


ITEM 


16 


0.76 


0.69 


10.2 


0.54 


0.56 


12.4 


ITEM 


17 


0.77 


0.66 


10.1 


0.57 


0.55 


12.5 


MEAN 




0.65 


11.5 


0.48 


0.54 


15.2 


S.O. 


0.15 


0.09 


1.4 


0.15 


0.C9 





HISPANIC 



SUMMARY t 

FORMULA SCORE 

• RIGHT 
f WRONG 

• OMITS 

• NOT REACHED 

COEFFICIENT ALPHA 
SAMPLE SIZE 
POPULATION ESTIMATE 



p* 


HB1S 


OELTA 


P4 


0.54 


0.66 


12.4 


0.70 


0.58 


0.60 


14.2 


0.55 


0.57 


0.65 


12.5 


0.70 


0.44 


0.55 


15.4 


0.56 


0.27 


0.44 


15.5 


0.54 


0.60 


0.49 


11.9 


0.72 


0.52 


0.47 


12.8 


0.44 


0.55 


0.45 


12.7 


0.62 


0.72 


0.50 


10.7 


0.61 


0.57 


0.54 


14.5 


0.52 


0.54 


0.46 


12.4 


0.72 


0.27 


0.47 


15.4 


0.56 


0.51 


0.52 


15.0 


0.47 


0.52 


0.47 


12.8 


0.69 


0.45 


0.56 


15.5 


0.41 


0.54 


0.45 


12.4 


0.71 


0.59 


0.57 


12.1 


0.72 


0.48 


0.54 


15.2 


0.62 


0.12 


0.06 


1.5 


0.15 



MEAN S.O. 


MEAN S.D. 


MEAN 2 


>.D. 


9.2 4.9 


4.9 4.5 


5.2 4 


>m 7 


11.0 5.7 


7.6 5.5 


8.0 3 


'.6 


5.5 9.4 


?.0 5.5 


••5 3 


'.6 


0.2 0.7 


0.5 0.9 


0.9 ( 


!. 8 


0.5 1.2 


1.1 2.2 


0.5 ] 


• 6 


0.79 


0.71 


0.75 




16579 


2957 


4115 




2666690 


4540?6 


472146 





TOTAL 



R6IS DELTA 



0.69 
0.67 
0.72 
0.45 
0.52 
0.57 
0.59 
0.45 
0.52 
0.65 
0.76 
0.54 
0.44 
0.75 
0.46 
0.49 
0.44 

0.45 
0.09 



10.9 
12.7 
10.9 
12.2 
14.4 
10.6 
11.6 
11.6 
9.5 
12.6 
10.6 
14.2 
15.5 
11.0 
11.9 
10.6 
10, - 

11.6 
1.5 



MEAN 
6.1 

10.2 
6.2 
0.2 
0.4 



S.D. 

5.1 

4.0 

5.6 

0.7 



0.60 

24919 
5662975 
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HSR 1980 SOPHOMORES 
WRITING 



WHITfc MALE 



WHITE TEHAI E 



BLACK MALE 



BLACK FEMALE 



HISPANIC MALE 



HISPANIC FEMALE 



ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 10 
ITEM 11 
ITEM 12 
ITEM 13 
ITEM I* 
ITEM 15 
ITEM 16 
ITEM 17 



MEAN 
S.O. 



P* 
0.60 
0.49 
0.65 
0.57 
0.34 
0.72 
0.64 
0.61 
0.81 
0.50 
0.72 
0.3* 
0.47 
0.67 
0.59 
0.70 
0.72 

0.60 
0.1? 



RBIS 
0.66 
0.64 
0.70 
0.64 
0.48 
0.56 
0.59 
0.43 
0.53 
0.61 
0.75 
0.54 
0.64 
0.72 
0.66 
0.68 
0.64 

0.62 
0.08 



OELTA 
11.1 
13.1 
11.5 
12.3 
14.7 
10.7 
11.6 
11.9 
9.4 
13.0 
10.7 
14.5 
13.3 
11.2 
12.1 
10.9 
10.7 

11.9 
1.4 



Pf 
0.8? 
0.66 
0.84 
0.68 
0.44 
0.80 
0.73 
0.69 
0.86 
0.63 
0.84 
0.46 
0.57 
O.fll 
0.74 
0.61 
0.82 

0.7? 
9. 13 



RBIS 
0.6? 
0.63 
0.68 
0.65 
0.56 
0.55 
0.59 
0.37 
0.43 
0.60 
0.74 
0.53 
0.64 
0.70 
0.67 
0.67 
0.64 

0.61 
0.09 



DELTA 

9.3 
11.3 

9.0 
11.2 
13.6 

9.6 
10.6 
11.1 

8.6 
11.6 

9.1 
13.4 
12.3 

9.4 
10.5 

9.5 

9.4 

10.6 
1.5 



P* 
0.48 
0.32 
0.52 
0.40 
0.23 
0.58 
0.49 
0.49 
0.70 
0.31 
0.50 
0.25 
0.28 
0.42 
0.3P 
0.50 
0.52 

0.43 
0.12 



RBIS 
0.65 
0.57 
0.61 
0.54 
0.41 
0.47 
0.47 
0.39 
0.44 
0.56 
0.66 
0.49 
0.50 
0.68 
0.44 
0.57 
0.52 

0.53 
0.09 



OELTA 

13.2 

14.9 

17.8 

14.0 

15.9 

12.2 

13.1 

13.1 

10.9 

15.0 

13.0 

15.7 

15.4 

13.8 

14.2 

13.0 

12.8 

13.7 
1.3 



P* 
0.61 
0.40 
0.65 
0.46 
0.28 
9.68 
0.54 
0.53 
0.75 
0.42 
0.62 
0.35 
0.31 
0.55 
0.46 
0.58 
0.61 

0.52 
0.13 



RBIS 
0.64 
0.65 
0.65 
0.60 
0.42 
0.44 
0.51 
0.29 
0.50 
0.53 
0.65 
0.48 
0.48 
0.67 
0.61 
0.54 
0.55 

0.54 
0.10 



OELTA 

11.9 

14.0 

11.4 

13.4 

15.4 

11.2 

12.6 

12.7 

10.3 

13.6 

li.8 

14.5 

15.0 

12.5 

13.4 

12.2 

11.9 

12.8 
1.4 



P* 
0.51 
0.33 
0.49 
0.40 
0.25 
0.58 
0.49 
0.51 
0.70 
0.31 
0.51 
0.25 
0.26 
0.48 
0.42 
0.51 
0.54 

0.44 
0.12 



R8IS 
0.62 
0.57 
0.61 
0.51 
0.40 
0.47 
0.45 
0.43 
0.47 
0.56 
0.67 
0.49 
0.50 
0.65 
0.55 
0.b3 
0.56 

0.54 
0.08 



OELTA 


P* 


12.9 


0.63 


14.8 


0-45 


13.1 


0.66 


14.0 


0.49 


15.7 


0.29 


12.2 


0.64 


13.1 


0.55 


12.9 


0.56 


10.9 


0.74 


15.0 


0.44 


12.9 


0.62 


15.7 


0.30 


15.3 


0.35 


13.2 


0.56 


13.B 


0.50 


12.9 


0.63 


12.6 


0.64 


13.6 


0.53 


1.3 


0.13 



R8IS 
0.69 
0.61 
0.66 
0.52 
0.48 
0.50 
0.46 
0.42 
0.53 
0.53 
0.67 
0.45 
0.53 
0.69 
0.61 
0.61 
0.56 

0.56 
0.08 



OELTA 

11.7 

13.5 

11.4 

13.1 

15.3 

11.6 

12.5 

12.4 

10.4 

13.6 

11.8 

15.1 

14.6 

12.4 

13.0 

11.6 

11.6 

12.7 
1.3 



SUMMARY: 

FORMULA SCORE 

« RIGHT 

» WRONG 

I OMITS 

I NOT REACH EO 



MEAN 
7.8 

10.0 
6.4 
0.2 
0.4 



S.O. 

5.0 

3.9 

3.8 

0.7 

1.3 



MEAN 
10.5 
12.0 
4.6 
0.2 
0.3 



S.O. 

4.3 

3.3 

3.1 

0.7 

1.0 



MEAN 
4.0 
6.9 
8.6 
0.4 
1.2 



S.O. 

4.3 

3.3 

3.6 

0.9 

2.3 



MEAN 
S.R 
R.3 
7.4 
0.3 
1.0 



S.O. 

4.S 

3.5 

3.4 

0.9 

2.1 



MEAN 
4.3 
7.3 
8.9 
0.2 
0.5 



S.O. 

4.5 

3.4 

3.5 

0.7 

1.6 



MEAN 
6.3 
8.8 
7.5 
0.3 
0.5 



S.O. 

4.7 

3.6 

3.6 

0.8 

1.5 



COEFFICIENT ALPHA 0.7* 
SAMPLE SIZE 814P 
POPULATION ESTIMATE 1326207 



0.75 
8431 
1362683 



0.68 
1331 
206459 



0.71 
1606 
227540 



0.71 
2046 
260069 



0.73 
2067 
211279 



2* 

f*> <j 



ERIC 
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MALE 



HS0 1980 SOPHOMORES 
CIVICS EDUCATION 

FEMALE 



ITEM 1 

ITEM 2 

ITEM 3 

ITEM 4 

ITEM 5 

ITEM 6 

ITEM 7 

ITEM 8 

ITE*« 9 

ITEM 10 

MEAN 
S.O. 

SUMMARY* 

FORMULA SCORE 

i RIGHT 

i WRONG 

• OMITS 

i NOT REACHED 

COEFFICIENT ALPHA 
SAMPLE SIZE 
POPULATION ESTIMATE 



*♦ 


RMS 


DELTA 


P* 


RBIS 


OELTA 


0.99 


0.69 


4.6 


0.96 


0.99 


9.9 


0.99 


0.96 


12.1 


0.69 


0.93 


11.4 


0.4? 


0*43 


11.8 


0.43 


0.40 


11.6 


0.99 


0.62 


12.1 


0.60 


0.96 


11.9 


0*44 


0*66 


11.6 


0.63 


0.41 


11.7 


0.33 


0.54 


U.7 


0.26 


0.30 


19.6 


0.49 


0.99 


13.1 


0. 99 


0#94 


12.1 


0.96 


0.99 


12.4 


0.61 


0.97 


11.9 


0*99 


0.63 


12.1 


0*62 


0.66 


11.8 


0.41 


0.48 


13.9 


0.43 


0.90 


19.7 


0.31 


0.39 


12.0 


0.60 


0.96 


11. R 


0*19 


0.06 


2.0 


0.17 


0.09 


2.3 



MEAN 
4.3 
9.7 
4.1 
0*0 
0.1 

0.94 
11798 
1824931 



S.O. 
2.7 
2.1 
2.1 
0.3 
0.7 



MEAN 
4.6 
9.9 
3.9 
0.1 
0.1 

0.49 
12327 
1824329 



S.O. 
2.6 
2.0 
2.0 
0.3 
0.6 



0.99 
0.62 
0.63 
0.60 
0.63 
0.29 
0.94 
0.98 
0.61 
0.42 

0.99 
0.16 



TOTAL 



P* RBIS OELTA 



0.63 
0.99 
0.41 
0.59 
0.63 
0.91 
0.94 
0.96 
0.64 
0.49 

0.98 
0.09 



MEAN 
4.9 
9.8 
4.0 
0.1 
0.1 

0.92 
24099 
3649?97 



S.O. 
2.7 
2.0 
2.0 
0.3 
0.7 
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I TEH 1 

ITEM 2 

I TEH 3 

ITEM * 

ITEM 5 

ITEM 6 

ITEM 7 

ITEM 8 

ITEM 9 

ITEM 10 

MEAN 
S.O. 

SUMMARY: 

FORMULA SCORE 

• RIGHT 

• WRONG 

# OMITS 

# NOT REACHED 



WHITE 



P* RBIS OELTA 

0.97 0.62 5.7 

0.6* 0.55 11.5 

0.67 0.61 11.3 

0.62 0.94 11. R 

0.67 0.63 11.3 

0.3? 0.53 U.9 

0.57 0.54 12.3 

0.62 0.56 11.8 

0.65 0.66 11.5 

0.44 0.49 13.6 

0.6? 0.58 U*6 

0.16 0.09 2.3 



ISB 1980 SOPHOMORES 
CIVICS EOUCATION 

BLACK 



RBIS OELT A 

0.93 0.53 7.1 

0.56 0.53 12.4 

0.52 0.55 12.7 

0.55 0.56 12.5 

0.52 0.56 12.8 

0.22 0.40 16.1 

0.48 0.49 13.2 

0.49 0.49 13.1 

0.49 0.55 13.1 

0.37 0.48 U.3 

0.51 0.52 12.7 

0.17 0.05 2.1 



HISPANIC 

P* RBIS OELT A 

0.91 0.64 7.7 

0.55 0.55 12.5 

0.51 0.59 12.9 

0.51 0.60 12.9 

0.54 0.62 12.6 

0.22 0.38 16.1 

0.47 0.51 n.3 

0.49 0.50 13.1 

0.46 0.54 13.4 

0.37 0.46 14.4 

0.50 0.54 12.9 

0.16 0.08 r.o 



TOTAL 



P* RBIS OFLTA 

0.95 0.63 6.3 

0.62 0.55 11. * 

0.63 0.61 11.7 

0.60 0.59 12.0 

0.63 0.63 11.6 

0.29 0.51 15.2 

0.54 0.54 12.6 

0.58 0.56 12.1 

0.61 0.64 11.9 

0.42 0.49 13.8 

0.59 0.58 11.9 

0.16 0.05 2.2 



MEAN S.O. 

4.8 2.6 

6.1 2.0 

3.7 2.0 

0.1 0.3 

0.1 0.6 



MEAN S.O. 

3.5 2.4 
5.0 1.9 

4.6 1.9 
0.1 0.4 
0.3 0.9 



MEAN S.O. 

3.4 2.6 

5.0 1.9 

4.8 2.0 

0.1 0.4 

0.2 0.7 



MEAN S.O. 

4.5 2.7 

5.8 2.0 

4.0 2.0 

0.1 0.3 

0.1 0. 7 



COEFFICIENT ALPHA 0.51 
SAMPLE SIZE 16455 
POPULATION ESTIMATE 2668144 



0.40 
2879 
424941 



0.45 
4067 
468731 



0.52 
24085 
3649257 



HSR 1980 S0PH0M0RFS 
CIVICS EDUCATION 



WHITE MALE 



WHITE FEMALE 



BLACK MAI. F 



BLACK FEMALE 



HISPANIC MALE 



HISPANIC FEMALE 



P* RBIS 

ITEM 1 0.96 0.66 

ITEM 2 0.61 0.56 

ITEM 3 0.66 0.62 

ITEM 4 0.62 0.62 

ITEM 5 0.68 0*66 

ITEM 6 0.36 0.55 

ITEM ? 0.52 0.54 

ITEM 6 0.59 0.56 

ITCM 9 0.63 0.65 

ITEM 10 0.42 0.48 

ATM 
S.O. 

SUMMARY: 

MEAN 

FORMULA SCORE 4.7 
# RIGHT 6.0 
I WRONG 3.9 
I OMITS 0.0 
t NOT REACHEO 0.1 

COEFFICIENT ALPHA 0.54 
SAMPLF SIZE 8090 
POPULATION ESTIMATE 1316715 



DFLTA 

6.1 
11.9 
11.4 
11.8 
11.2 
14.4 
12.8 
12.1 
11.7 
13.8 



0.60 0.59 11.7 
0.15 0.06 2.1 



S.O. 
2.7 
2.1 
2. I 
0.3 
0.6 



P* 
0.98 
0.6* 
0.67 
0.63 
0.66 
0.28 
0.61 
0.64 
0.67 
0.45 



RBIS 
0.52 
0.53 
0.60 
0.55 
0.60 
0.5? 
0.53 
0.56 
0.66 
0.50 



0.6J 0.56 
0.17 0.05 



MEAN 
5.0 
6.2 
3.6 
0.1 
0.1 



DELTA 

5.1 
11.2 
11.2 
11.7 
11.3 
15.4 
11.8 
11.5 
11.3 
13.5 

1 1.4 
2.5 



S.O. 

2.5 

1.9 

1.9 

0.3 

0.6 



0.47 
8365 
1351428 



P* 
0.93 
0.55 
0.52 
0.54 
0.52 
0.25 
0.44 
0.48 
0.49 
0.36 



RMS 
0.49 
0.*6 
0.57 
0.58 
0.57 
0.40 
0.48 
0.45 
0.51 
0.48 



0.51 0.51 
0.17 0.06 



MEAN 
3.4 
4.9 
4.7 
0.1 



DFLTA 

7.0 
12.5 
12.8 
12.6 
12.8 
15.7 
13.6 
13.2 
13. 1 
14.5 

12.8 
2.1 



S.D. 

2.4 

1.9 

1.9 

0.4 

1.0 



0.39 
1302 
201874 



P* 
0.93 
0.57 
0.53 
0.56 
0.52 
0.20 
0.51 
0.51 
0.49 
0.39 



RR1S 
0.57 
0.49 
0.52 
0.54 
0.59 
0.41 
0.49 
0.53 
0.59 
0.48 



0.52 0.5? 
0.17 0.05 



MEAN 
3.6 
5.1 
4.6 
0.1 
0.3 



DELTA 

7.2 
12.3 
12.7 
12.4 
I /. 8 
16.4 
12.9 
12.9 
13.1 
14.2 

12.7 
2.2 



S.P. 

2.4 

1.9 

1.9 

0.4 

0.9 



0.40 
1577 
22306T 



P* 
0.90 
0.51 
0.52 
0.51 
0.53 
0.24 
0.44 
0.47 
0.46 
0.35 

0.49 
0.16 



RBIS 
0.66 
0.56 
0.60 
0.61 
0.63 
0.43 
0.4R 
0.49 
0.52 
0.43 

0. 54 
0.08 



NF AN 
3.2 
4.9 
4.9 
0.1 
0.2 



DELTA 


P* 


7.9 


0.92 


12.9 


0.60 


12.8 


0.49 


12.9 


0.52 


12.7 


0.55 


15.8 


0.19 


13.6 


0.51 


13.3 


0.53 


13.4 


0.46 


14.6 


0.39 


13.0 


0.52 


1.9 


0.17 



S.O. 

2.6 

2.0 

2.0 

0.3 

0.7 



0.46 
2018 
259239 



RBIS 
0.61 
0.54 
0.58 
0.59 
0.60 
0.33 
0.55 
0.51 
0.56 
0.49 

0. 54 
0.08 



MEAN 
^.5 
5.1 
4.7 
0.1 
0.2 



DELTA 

T.4 
12.0 
13.1 
12.8 
12.5 
16.5 
12.9 
12.7 
13.4 
14.1 

12.7 
2.1 



S.D- 

2.5 

1.9 

2.0 

0.4 

0.7 



0.45 
?049 
209493 



00 
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APPENDIX E 
HS&B 1982 Senior Item Analysis Tables 

El 1982 Vocabulary Male-Female 

E2 1982 Vocabulary White-Black-Hispanic 

B3 1982 Vocabulary White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

B* 1982 Reading Male-Female 

1982 Reading White-Black-Hispanic 

E ° 1982 Reading White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

27 1982 Mathematics Male-Female 

28 1982 Mathematics White-Black-Hispanic 

29 1982 Mathematics White Male-White Female-Black Male- 

Black Female-Hispanic Male-Hispanic Female 

E10 1982 Sconce Male-Female 

Ell 1982 Science White-Black-Hispanic 

E12 1982 Science White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

E13 1982 Writing Male-Female 

E14 1982 Writing White-Black-Hispanic 

E15 1982 Writing White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 

B16 1982 Civics Education Male-Female 

E17 1982 Civics Education White-Black-Hispanic 

E18 1982 Civics Education White Male-White Female-Black Male- 
Black Female-Hispanic Male-Hispanic Female 
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El 



MSA 191? SENIORS 
VOCABULARY 







MALE 




FEMALE 




TOTAL 






















P* 


MIS 


AFI TA 
Url 1 II 




MIS 


nc it* 
UCl T A 




801 S 


OELTA 


item i 


0.77 


o.ao' 


10.0 


0.79 


0.79 


9.7 


0.78 


0.79 


9.9 


ITEM 7 


0.91 


0.83 


7.6 


0.86 


0.80 


8.6 


0.09 


0*91 


0.2 


ITEM 3 


0.74 


0.83 


10.6 


0.75 


0.03 


10.6 


0.74 


0.63 


10.6 


1 1(1 ^ 


0.8? 


0.76 


9.3 


0.80 


0.7* 


9.6 


O.M 


0.73 


9.5 


ITCf» 5 


0.03 


0.79 


9.2 


0.86 


0.78 


9.0 


0.83 


0.79 


9.1 


ITF4 6 


0.59 


0.76 


12.0 


0.55 


0.74 


12.5 


0.97 


0.75 


12.3 


ITFM 7 


0.'.? 


0.74 


11.7 


0.70 


0.79 


10.9 


0.66 


0.76 


11.3 


1U" n 


0.94 


0.82 


9.0 


0.77 


0.80 


10.1 


0.80 


0.81 


9.6 


1TIM 9 


0.67 


0.7ft 


11.2 


0.73 


0.60 


10.5 


0.70 


0.78 


10.9 


ITM 10 


0.69 


0.71 


11.1 


0.60 


0.62 


12.0 


• 64 


0.66 


11.6 


ITEM M 


0.74 


0.73 


10.3 


0.73 


0.7? 


10.6 


U.74 


0.72 


10.4 


ITM U 




0.67 


9.6 


0.71 


0.62 


10.8 


0.76 


0.66 


:o.i 


ITEM 13 


0.47 


0.69 


13.3 


0.53 


0.71 


12.7 


0.90 


0.T0 


n.o 


ITM 14 


0.3S 


0.69 


16.6 


0.38 


0.71 


16.2 


0.36 


0.70 


14.4 


IT*« 15 


0.?2 


0.45 


14.9 


0.3? 


0.65 


16.9 


0.3? 


0.65 


14.9 


I TfcM 16 


0,54 


0.58 


12.6 


0.58 


0.60 


12.2 


0.56 


0.58 


12.4 


ITFM 17 


0.47 


0.68 


13.9 


0.66 


0.6? 


13.6 


0.65 


0.65 


13.5 


ITT* 10 


0.34 


0.*7 


16.9 


0.32 


0.53 


16.9 


0.36 


0.55 


14.7 


ITW 19 


0.26 


0.19 


15.3 


0.12 


0.27 


16.9 


0.30 


0.23 


15.1 


ITEM 20 


0.26 


0.43 


1? 


0.2* 


0.66 


15.7 


0.26 


0.66 


15.6 


ITIM 71 


0.36 


0.57 


14 


0.6? 


0.66 


13.8 


0.39 


0.62 


16.1 


Ht*N 


0.59 


0.67 


11.9 


0.59 


0.67 


12.0 


0.99 


0.67 


11.9 




0.21 


0*16 


2.3 


0.19 


0.16 


2.1 


0.20 


0.15 


2.2 


SUMMARY! 






















MEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.O. 


FORMtKA SfORF 


10.4 


5.6 


10.3 


5.0 


10 


• 6 


5.7 


• RIGHT 


12.4 


6.6 


12.3 


4.7 


12 


• 6 


4.7 


f U'QIG 


7. 


6 


6.5 


7, 


9 


4.6 


7 


.9 


4.6 


# OMITS 


0. 


6 


1.7 


0. 


6 


1.7 


0 


• 6 


1.7 


• NOT 0EACHEO 


0.2 


1.? 


0. 


1 


0.9 


0.2 


1.0 


COE»HClF"T kiPHK 




0.86 






0.05 






0.86 








1?865 






I3?53 




76110 




»0»UUTU»| fSTlHATf 


1979443 




1887097 


376<54P 
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white 



HSf) 198? SFNIOPS 
VOCAB'JL&RV 

BLACK 



HISPANIC 



1TFM 1 
ITEM 2 
ITEM 3 
ITEM * 
ITFN 5 
1TFM 6 
ITfM 7 
ITF" 8 
ITEM 9 
1TF" 10 
ITFN U 
ITEM 12 
ITEM 13 
IT** 14 
ITEM 19 
ITFH 16 
ITEM 17 
ITEM 18 
ITEM 19 
ITEM 20 
ITEM 21 

MP AN 
S.D. 

SUMMARY t 

MF AN S.O. 

FORMULA SCPRF 11.7 5.? 

9 RlGHl M.4 4.3 

• wrn\'G ft. 9 4.1 

0 OMITS 0.5 1.6 

• NHT REACHED 0.1 ft. 9 

COEFFICIENT ALPHA 0.82 
SAMPLE SIZE 17?12 
POPULATION FSTIMATF 2727)55 



P* 

0.*5 
0.94 
O.ftl 
O.AQ 
0.*B 

0.A4 

0.73 
0.K7 
0.77 
0.70 
0.79 

o.r? 

0.56 
0.4? 
0.54 

0.60 

o.so 

0.17 
0.31 
0.?7 
0.44 

0.f4 
0.?1 



RMS OFl. TA P* RMS DELTA P* R8CS 0 



0.77 
0.81 
0.8* 
0.69 
0.78 
0.74 
0.74 
0.90 
0.77 
0.65 
0.74 
0.6? 
0.71 
0.70 
0.49 
0.57 
0.66 
0.96 
0.?4 
0.51 
0.6? 

0.67 
0.14 



8.P 

6.9 
9.5 
8.1 
8.? 
11.6 
1C* 
8.5 
10.1 
10. ■ 
9.7 
*>.4 
17.4 
13.8 
14.6 
12.0 
13.0 
14.3 
15.0 
15.4 
13.7 

11.3 
2.5 



0.5/ 
0.73 
0.56 
0.58 
0.69 
0.38 
0.46 
0.56 
0. ? 

O.vl 

0.60 
0.59 
0.33 
0.21 
0.24 
0.4* 
0.31 
0.2* 
0.26 
0.22 
0.?3 

0.44 
0.16 



0. 70 
0.67 
0.75 
0.69 
0.66 
0.60 
0.68 
0.69 
0.7? 
0.53 
0.61 
0.47 
0.46 
0.59 
0.27 
0.56 
0.54 
0.44 
0.22 
0.28 
0.49 

0.56 
0.15 



MEAN 
6.4 
9.1 

10.8 
0.8 
0.1 



1?.3 
10.6 
12.3 
12.? 
11.0 
14.3 
13.4 
12.2 
12.8 
13.9 
)?.0 
l?.t 
14.8 
16.2 
15.8 
13.7 
15.0 
15.8 
15.5 
16.0 
16.0 

J3.7 
1.7 



• 0. 



1. 



0.6? 
0.76 
0.57 
0.62 
0.70 
0.39 
0.48 
0.63 
0.53 
0.51 
0.58 
0.61 
0.34 
0.20 
0.25 
0.45 
0.32 
0.?? 
0.31 
0.71 
0.29 

0.46 
0 17 



0.71 

0.7? 

0.73 

0.67 

0.71 

0.47 

0.68 

0.71 

0.67 

0.57 

0.59 

0.56 

0.57 

0.61 

0.? 

0.57 

0.55 

0.40 

0.?* 

0.?8 

0.53 

0.57 
0.14 



MEAN 
6.9 
9.5 

10.5 
0.7 
0.3 



TOTU 

LTA MIS OELTa 



S.O. 

5.4 

4.4 

4.5 

2.0 

1.3 



0.78 
0.89 
0.74 
0.81 
0.83 
0.57 
0.66 
0.80 
0.70 
0.64 
0.74 
C.76 
0.50 
0.36 
0.32 
0.56 
0.45 
0.34 
0.30 
0.26 
0.39 

0.59 
0.20 



0.79 
0.81 
0.83 
0.75 
0.78 
0.79 
0. 76 
0.81 
0.78 
0.66 
0. 72 
0.64 
0.70 
0.70 
0.45 
0.98 
0.65 
0.95 
0.29 
0.44 
0.62 

0.67 
0.15 



MEAN 
10.4 
12.4 
7.9 
0.6 
0.2 



S.O. 

5.7 

4.7 

4.6 

1.7 

> 0 



0.79 
3467 
456832 



0.80 
4499 
47473* 



0.84 
26118 
3766540 
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VMITF MAI F 



WHITF FFMAtr 



BLACK HALF 



BLACK FF*ALF 



HISPANIC HALF 



HISPANIC FENALF 



ITFM 
ITEM 
ITEM 
ITS" 

irrn 

ITFM 

ITrn 

ITFM 
ITFM 
ITFM tO 
ITfcM tl 
ITFM 12 
ITFN 13 
ITFM |* 
ITFM 15 
ITEM 1* 
ITEM 17 
ITFM 18 
ITEM 10 
I TL M ?0 
ITFM 71 




M 



Mr ah 

S.!>. 



0.64 0.67 11./ 
0.2? 0.1* 7.7 



0.h4 0.67 U.3 0.46 0.5* 13.4 
O.n ?.* O.IB 0.16 1.9 



0.41 0.S4 14.0 0.46 0.38 13.5 0.46 0.57 13.5 
0.15 0«t5 1.6 O.IB 0.15 1.9 0.16 0. U 1.7 



SUMMARY: 

FrviMllLA SCORF 

« WP'ING 
I UNITS 
I rftU HI ACHED 



11.7 
13.4 

f • n 

0.6 
0.2 



s.n. 

5.1 
V.2 
4.1 

1.0 



CUFM ICIENT ALPHA 0.8? 
SAMPIC SI7t 8465 
*»OPlMATfON FSTIHATF M40391 



Mf AM 
11.7 
13.4 
6.9 
O.S 
O.I 



S.O. 

5.T 

4.* 

4.2 

1.9 

0.7 



0.83 
8747 
1386964 



MEAN 
7.0 
9.* 

10.4 
0.7 
0.4 



s.o. 

5.4 

1.8 
1.5 



0. AO 
1619 
217??7 



NF AN 
5.» 
8.6 

11.2 
O.o 

0.3 



S.O. 

3.1 

4.2 

4.S 

2.4 

1.3 



0.77 
MM 
230606 



MEAN 
6.9 
9.5 

10.3 
O.B 
0.3 



• 0. 



0.80 
2399 
?M109 



MEAN 
6.9 
9.5 

10.7 
0.6 
0.2 



S.O. 

9.5 

4.5 

4.6 

1.6 

1.2 



3.80 
2300 
213628 
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E4 



HSP 194? SFNJORS 
READING 



MAI F 



FFMALF 



TOTAL 



























MIS 


DELTA 




RBIS 


DELTA 




861 S 


!T«"rt 


1 


0.9? 


0.41 




0.92 


0.57 


7.4 


0.92 


0.59 


ITEM 


? 


0.8? 


0*64 




0.82 


0.62 


9.3 


3.92 


0.53 


ITEM 


3 


0.75 


0*64 




0.77 


0.5o 


10.0 


0.76 


0.40 


ITEM 


S 


0.66 


0.67 




0.61 


0*66 


11.9 


0.63 


0.66 


ITFM 


6 


0.55 


0.60 




0.55 


0.66 


12.5 


0.55 


0.63 


MEM 


V 


0.4A 


0.58 




0.46 


0.59 


13.4 


0.46 


0.58 


ITbM 


8 


0*47 


0.71 




0.42 


0.66 


13. * 


0.45 


0.69 


ITF* 


9 


0.18 


0.3* 




0.18 


0.54 


16.6 


0.19 


0.47 


ITEM 


10 


0.49 


0.58 




0.55 


0.62 


12.5 


0.50 


0.60 


ITEM 


11 


0.39 


0.5? 




0.32 


0.51 


14.9 


0.33 


0.91 


ITFM 


12 


0.75 


0.65 




0.81 


0.58 


9.4 


0.78 


3.61 


ITEM 


13 


0.54 


0.71 




0.53 


0.75 


12.7 


0.53 


0.74 


IT** 


14 


0.69 


0.69 




0.65 


0.66 


11.5 


0*67 


0.68 


ITEM 


15 


0.42 


0.68 




0.39 


0.66 


14.1 


0.41 


0.67 


ITEM 


1* 


0.49 


0*66 




0.54 


0.70 


12.6 


0.52 


0.48 


ITFM 


17 


0.33 


0.56 




0.36 


0.55 


14.4 


0.39 


0.59 


ITfM 


in 


0*47 


0.68 




0.37 


0.66 


14.3 


0.42 


0.67 


ITFM 


i? 


0.27 


0.45 




0.25 


0.39 


15.7 


0.26 


0.42 


ITEM 


20 


0.49 


0.65 




0.51 


0.65 


12.9 


0.50 


0.65 


KF AN 


0.53 


0.62 


12.6 


0.53 


0.61 


12.6 


0.53 


0.41 


5.D. 


0.19 


9.09 




0.20 


0.08 


2.1 


0.19 


0.08 



SUMMARY S 

fOR*'JlA Sf ORE 
§ MGHT 

• WRONG 

• 0«IT* 

• NPT REACHED 

COEFFICIENT ALPHA 
SAHVLF SIZE 
POPULATION FSTIMATE 



MEAN 
7.7 
9.8 
8.5 
0.1 
0.6 



S.D. 
5.1 
4.2 
4.0 

5. 6 



O.Rt 
12773 
1867160 



MEAN 
7.6 
9.8 
8.6 
0.1 
0.6 

0.40 
13175 
1877582 



S.D. 
5.0 
4.1 
4.0 
0.6 
1.9 



MEAN 
7.7 
9.8 
8.5 
0.1 
0.6 



s.o. 

5.1 
4.2 
4.0 
0.6 
1.9 



0.*C 
25948 
374474? 
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E5 



MSB 19*2 SFNtORS 
READING 











HHITF 






BLACK 






HISPANIC 




TOTAL 










P* 


*HS 


OELTA 


P* 


RBIS 


DEI TA 


P* 


RRIS 


OEITA 


P* 


RMS 


OEITA 


1TPM 


1 




0.94 


0.98 


6. 


7 


0.R6 


0.92 


R.7 


0.R9 


0.97 




0.97 


0.99 




ITEM 


2 




0.86 


0.61 


R. 


6 


0.70 


0.97 


10.8 


0.69 


0.99 


ulo 


0.9? 


0.63 




1TFN 


y 




O.RO 


0.63 


9. 


7 


0.66 


0.90 


11.3 


0.66 


0.48 


11.3 


0.76 


0.60 


10I1 


ITEM 


9 




0.69 


0.69 


11. 


1 


0.9) 


0.62 


12.7 


0.4R 


0.69 


13.2 


0.61 


0.66 


11.6 


ITfM 


6 




0.60 


0.60 


12. 


0 


0.41 


0.62 


13.0 


0.40 


0.69 


14.0 


0.95 


0.63 


12.5 


ITEM 


7 




0.50 


0.90 


13. 


0 


0.32 


0.48 


14. R 


0.37 


0.47 


14,4 


0.46 


0.93 


13.4 


ITE* 


R 




0.50 


0.60 


13. 


0 


0.30 


0.91 


19.1 


0.30 


0.64 


19.1 


0.49 


0.69 


13.9 


ITEM 


9 




0.19 


0.9? 


16. 


9 


0.14 


0.23 


17.3 


0.16 


ft. 29 


17.0 


O.tR 


0.47 


16.6 


Iff* 


10 




0.54 


0.99 


12. 


6 


0.39 


0.93 


14.2 


0.3R 


0.91 


14.2 


0.90 


0.60 


13.0 


ITEM 


11 




0.16 


0.9? 


14. 




0.74 


0.41 


19.8 


0.76 


0.^8 


19.6 


0.33 


0.91 


14.7 


ITE" 


12 




0.91 


0.62 


0. 




0.71 


0.93 


10. • 


0.65 


0.96 


11.4 


0.7R 


0.61 




ITEM 


13 




0.49 


0.73 


1?. 




0.39 


0.70 


14.9 


0.37 


0.69 


14.1 


0.93 


0.74 


xzli 


ITEM 


14 




0.7? 


0.*7 


10. 




0.93 


0.62 


12.7 


0.92 


0.64 


12. R 


0.67 


0.68 


11.3 


1 TEH 


19 




0.49 


0.65 


13. 




0.29 


0.67 


19.7 


0. 77 


0.65 


19.9 


0.41 


0.67 


14.0 


ITEM 


16 




0.97 


D.6R 


12. 




0.34 


0.97 


14.6 


0.37 


0.56 


14.3 


0.92 


0.61 


12.8 


ITEM 


17 




0.3* 


0.9/, 


M. 




0. 2>f 


0. 44 


15.5 


0.25 


0.46 


19.7 


0.99 


0.99 


14.6 


ITEM 


14 




0.47 


0.67 


13. 




0.24 


0.58 


15.8 


0.29 


0.93 


19.2 


0.4? 


0.67 


13.R 


ITEM 


19 




0.20 


0.44 


19. 




0.19 


0.70 


16.4 


0.21 


0.78 


16.2 


0.24 


0.42 


19.6 


ITE M 


20 




0.55 


0.A4 


1*. 




0. 14 


0.95 


14.7 


0.34 


0.60 


14.6 


0.50 


0.69 


13.0 


Mf AN 




0.57 


0.61 


12. 




0.41 


0.9? 


14.0 


0.41 


0.91 


13.9 


0.93 


0.61 


12.6 


S.O. 




0.10 


0.07 


2. 




0.19 


0.13 


2.2 


0.1R 


0.11 


2.0 


0.19 


0.08 




SUMMARY! 




































rFAN 


S.O. 




HFAN 


S.O. 


"PAN 


S.O. 


MFAN 


S.O. 


FORMULA SCORE 


8. 


6 


s.o 




4.8 


4.1 


4.9 


4.3 


7.7 


9.1 


1 RIGHT 




10.6 


4.1 




7.3 


3.4 


7.9 


3.6 


9 


• 9 


4.2 


0 WRONG 




7.9 


3.9 




10.0 


3.7 


10.9 


3.7 


8.9 


4.0 


* OMITS 




0.1 


0.5 




0.2 
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I TP < 9 
IT*M 10 
ITEM il 
ITEM 12 
ITFM 13 
ITFM I* 
ITFM 15 
ITFM 1* 
ITFM 17 
ITF f .R 
ITFM 19 
I TFH 20 

MT AN 

Sir j MAr.v : 

FfMIII A SCUf'f 

* Rlf.IlT 
H w,WG 

* OMMS 

V T TFACMFO 

LJtTr If. IT Ml At HI I A 

SA*i>tr SI/F 

PUPIItf HON FSTlMAH 



P* 
0.9 J 
->.rtl 
0.7 s ! 
O.RJ 
0.90 
O.oi 
0.62 
0.R5 
0.H2 
0.7 7. 
0.74' 
0.59 
0.67 

c.-"> 

0.54 
0.42 
O.^o 
0.39 
0. 4* 
0.2? 

•?.6* 
0.21 



0. 74 
0. 17 
0.7? 
0.6* 
0.7<i 
0.53 
0.54 
0.79 
0.69 
0. *5 
0.63 
0.69 
0. 7 5 
0.47 
0.5* 
0.52 
0.66 
0.46 
0.56 
r .'3 

0. C R 
0. |S 



9*1 TA 
7.8 
9.H 
9.9 
0.6 
7.8 
7.6 

I l.R 
H.B 
9.3 

10. I 

10.* 

!?.l 

11.3 

IS. | 

12.6 

13. R 

12.1 

14.2 

14.3 

16.1 

I 1.7 
2.5 



*4F AM 
11.2 
12.9 
(••6 

a. 2 

0.3 j 

«M4 
110/ JO r i 



s.o. 
4.4 

1.6 
0. H 



P* 
0.89 

0. 79 
0.71 
O.R> 
O.RO 
0.6S 
0.7R 
0. 70 
0.71 
0.56 
O.S't 
0.67 
C. ?4 
0. 36 
0.44 

0. ^7 
0.2O 
0.20 

0.*1 
0.21 



PRf S 
0.61 
0.4 J 
0.6* 
0.54 
0.70 
0.52 
0.52 
0.63 
0.69 
0.36 
0.55 
0.6H 
0.65 
0.41 
0.35 
0.43 
0.61 
0.41 
0.43 
0.20 

0.52 
0.1 J 



on t a 

8.0 
9.3 
9.8 

10. R 
9.4 
8.2 

I 1.5 
".9 

10.9 

10. R 

12.4 

1^.6 

11.3 

I 5.R 

14.4 

13.6 

12.6 

14.3 

15.2 

16.3 

1 1.9 
2.4 



*rAM 
n.o 

1 1.9 
7.6 
0.3 
0.2 

0.70 
44<M 
134R166 



S.O. 

3.4 
1.4 
0." 
1.0 



p* 

0.82 
0.71 
0.60 
0.61 
0.S5 
n.80 
0. 34 
0.61 
0.39 
0.63 
0.46 
0.16 
0.39 
0.16 
0.4! 
0.29 
0. 33 
0.27 
0.19 
0.22 

0.46 
0. 19 



p.im 

0.S9 

0.44 

C.61 

0.57 

0.73 

0.49 

0.54 

0. 72 

0.6P 

0.42 

0.59 

0.61 

0.62 

0.43 

0. 35 

0.50 

0. 71 

0.29 

0, 20 

0.">2 

0.52 
0. 16 



OFt TA 
9.4 

10. R 

12.0 

11.9 

12.5 
9.6 

14.6 

11.9 

14. 1 

11.6 

13.4 

14.4 

14.1 

16.9 

14.0 

15.2 

14. R 

15.4 

16.5 

t6.0 

13.* 
2.1 



Mr 
6.4 
R.R 
9.7 
0.3 
1.1 



5.0. 

4.5 

3. 7 

l.R 

0.9 

2.3 



P* 
0. 76 
0.62 
0.59 
0.51 
0.44 
0.76 
0.33 
0.51 
0.26 
0.52 
0.31 
0.34 
0.37 
0. 13 
0.17 
0.27 
0.?8 
0. ?3 
0.20 
0.21 

0.40 
O.I R 



RRIS 

0.5 7 

0.52 

0.56 

0.47 

0.67 

0.41 

0.55 

0.52 

0.58 

0.41 

0.42 

0.44 

0.54 

0.39 

0.14 

0.34 

0.53 

0.16 

0.27 

0.19 

0.44 
0.13 



OFLTA 

10.1 

11.8 

12.1 

12.9 

13.6 

10.1 

14.8 

12.9 

15.6 

12.8 

15.0 

14.7 

U.3 

17.6 

14.3 

15.5 

15.4 

15.9 

16.3 

16.0 

14.1 

2.0 



M FAN 
s.l 

7.R 
10.R 
0.5 
0.9 



S.o. 

l.R 

3.1 

3.5 

l. 1 

2.0 



P* 
0.76 
0.6R 
0.56 
0.63 
0.67 
O.RO 
0.45 
0.66 
0.54 
0.67 
0.53 
0.37 
0.39 
0. 19 
0.41 
0.25 
0.31 
0.29 
0.21 
0.21 

0.4R 
0.19 



PRIS 

0.65 

0.47 

0.65 

0.56 

0.76 

0.61 

0.49 

0.70 

0.64 

0.45 

0*65 

0.54 

0.63 

0.39 

0.43 

0.42 

0.67 

0.29 

0.41 

0.15 

0.S3 
0.15 



OFLTA 
10.2 
tl.l 
12.4 
11.6 
11.2 
9.6 
13.5 
11.4 
12.6 
11.2 
12.7 
14.4 
14.1 
16.6 
13.9 
15.7 
14.7 
lli. 2 
16.3 
16.3 

1 3.2 
2. 1 



MFAN 
7.0 
9.4 
9.6 
0.1 
0.6 



S.O. 

4.6 

3.8 

1.8 

1.0 

l.R 



P* 
0.76 
0.69 
0.5R 
0.55 
0.54 
0.77 
0.44 
0.57 
0.39 
0.60 
0.39 
0.35 
0.45 
0.17 
0.34 
0.30 
0.30 
0.26 
0.24 
0.21 

0.44 
0.18 



PUIS 

0.57 

0.48 

0.65 

0.48 

0.67 

0.53 

0.46 

0.64 

0.66 

0.44 

0.50 

0.63 

0.62 

0.38 

0.27 

0.41 

0.71 

0.35 

0.26 

0.12 

0.49 
0.16 



DELTA 

to.? 

11.1 
12.2 
12.5 
12.6 
10.0 
13.6 
12.1 
14.1 
11.9 
14.1 
14.6 
13.5 
16.8 
14.7 
15.2 
15.1 
15.6 
15.8 
16.2 

13.6 
1.9 



MFAN 
6.2 
8.7 

10.3 
0.3 
0.6 



S.O. 

4.4 

3.6 

3.6 

1.3 

1.7 



W 



0.7? 
1562 
20932 7 



0.59 
1794 
234R30 



0.74 
2326 
252812 



0.69 
2211 
207260 




ERIC 
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1TFM I 
1TE* 2 
1TF* 3 
1T*M 4 
ITtM 5 
ITF^ o 
ITCH 7 
I TFM 0 
ITFM 9 
ITEM 10 
ITF* 11 
ITEM 12 
1TFM 13 
ITEM 14 
ITEM 15 
ITfM 16 
ITEM IT 

MFA'J 
S.O. 

Stl*MAftV: 

FORMULA SC0«F 
« klGHT 

• WRONG 

• OMITS 

• NOT REACHED 



NAIF 

«M1 DF.LTA 

0.69 0.71 11.0 

0.51 0.69 12.9 

0.6" 0.71 11.0 

0.56 0.65 12.* 

0.35 0.49 14.5 

0.73 0.60 10.5 

0.** 0,6? 11.6 

0.4* 0.46 11.6 

O.H.? 0.«9 9.3 

0.57 0-70 12.3 

0.7) O.bl 10.5 

0.17 0.60 u.3 

0.5? 0.69 12. 8 

0.69 0.79 11.1 

0.61 0.^1 11.7 

0.71 0.74 10.6 

fl.7? 0.71 10.6 

0.6' 0.66 11.T 

0.1? 0.09 1.3 



HSP 19112 SENIORS 
WRITING 

FEMALE 



P* RRIS OELTA 

0.83 0.74 9.4 

0.68 0.74 ll.t 

0.96 0.7* 0.7 

0.67 0.68 11.2 

0.49 0.<7 13.1 

O.flO 0.57 9.6 

0.73 0.63 10.5 

0.71 0.41 10.* 

0.87 0.*3 8.5 

0.72 0.71 10.7 

0.84 0.85 9.1 

0.47 0.60 13.1 

0.61 0.73 11.9 

0.80 0.81 9.6 

0.75 0.78 10.3 

0.82 0.77 «.3 

0.92 0.7? 9.3 

0.73 0.68 10.4 

0.12 0.11 1.4 



TOTAL 

P+ RBIS OELTa 

0.76 0.74 10.2 

0.59 0.73 12.0 

0.77 0.?5 10.0 

0.62 0.68 11.8 

0.42 0.54 13.8 

0.77 0.60 10. 1 

0.69 0.63 11.1 

0.67 0.44 11.3 

0.8* 0.47 8.9 

0.65 0.72 11.5 

0.78 0.»I4 9.9 

0.42 0.61 13.8 

0.57 0.71 12.3 

0.74 0.81 10.4 

0.69 0.75 11.0 

0.77 0.77 10.0 

0.78 0.73 10.0 

0.69 0.6* 11.1 

0.12 0.10 1.3 



MEAN 
8.2 

10.2 
6.0 
0.2 



s.o. 

5.4 
4.2 
3.9 
0.4 
1.6 



MEAN 
10.8 
12.2 
4.3 
0.2 
0.4 



S.O. 

4.8 

3.8 

3.4 

0.6 

1.4 



MEAN 
9.5 

11.? 
5.1 
0.2 
0.4 



S.O. 

5.3 

4.1 

3.8 

0.7 

1.5 



CCFrFICl^NT ALf MA 
SANPLF SIZE 
POPULATION FSTIMATE 



O.fl? 
12429 
181347? 



O.M 
1274? 
14216F1 



0.83 
2*17! 
3635152 
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E14 



WHITE 



HSB 198? SFNIORS 
WRITING 



HISPANIC 



TOT A! 



P* MIS OFITA P4 MIS OEITA P* RR!$ OFITA P* Mil OEITA 



ITEM 1 

ITEM 2 

1TFM 3 

I TF* 4 

ITEM 5 

ITf* 6 

ITfM 7 

IfFH H 

ITfH 9 

ITFH 10 

JTFH U 

IT?- 12 

ITFH 13 

IT£H 14 

ITFH 15 

ITEM 16 

ITFH 17 

MEAN 
S.3. 

SU*4A*yt 

M 5AN S.O. 

FPPH'JIA SCO*F 1C.6 4.9 

* RIGHT l?.l 3.8 

* K*ONG 4.5 3.5 

* r-UTS 0.2 0.6 
I NOT RFACHFD 0.3 1.2 

C0FFF1C1FKT ALPHA 0.81 
SAM.HF SIZr 1664? 
PCM Jl AT J ON FSTIMATF 26173*1 



0.80 
0.66 
0.81 
0.67 
0.46 
0.80 
0.73 
0.71 
0.87 
0.70 
0.83 
0.46 
0.63 
0.80 
0.75 
0.8? 
0.82 

0.72 
0.12 



0.75 
0.72 
0.78 
0.68 
0.57 
0.42 
0.64 
0.40 
0.53 
0.7? 
0.6* 
0.61 
0.73 
0.8? 
0.7'i 
0.77 
0.72 

0.68 
0.11 



9.6 
11.4 
9.5 
11.3 
13.4 
9.6 
10.6 
10.8 
8.4 
10.9 
9.1 
13.4 
11.7 
9.6 
10.3 
9.4 
9.3 

10.5 
1.4 



0.62 
0.39 
0.68 
0.48 
0.32 
0.69 
0.58 
0.54 
0.76 
0.51 
0.65 
0.33 
0.37 
0.58 
0.50 
0.6? 
0.61 

0.54 
0.13 



0.66 
0.66 
0.63 
0.60 
0.3? 
0.45 
0.56 
0.42 
0.58 
0.61 
0.73 
0.54 
0.51 
0.67 
0.65 
0.6« 
0.62 

0.58 
0.10 



MEAN 
6.3 
8.6 
6.9 
0.4 
1.2 



11.7 
14.1 
11.1 
13.2 
14.9 
11.1 
12.2 
12.6 
10.1 
12.9 
11.5 
14.7 
14.3 
12.2 
13.0 
11.8 
11.9 

12.6 
1.3 



S.D. 

4.8 

3.8 

3.6 

1.1 

2.3 



0.63 
0.44 
0.66 
0.47 
0.29 
0.66 
0.56 
0.59 
0.75 
0.48 
0.62 
0.31 
C.38 
0.58 
0.52 
0.67 
0.63 

0.54 
0.13 



0.68 
0.64 
0.64 
0.58 
0.45 
0.54 
0.56 
0.47 
0.57 
0.65 
0.76 
0.6? 
0.5' 
0.74 
0.67 
0.70 
0.65 

0.62 
0.08 



11.7 
13.6 
11.4 
13.3 
15.3 
11.3 
12.4 
12.0 
10.3 
13.2 
11.8 
'«.0 
. .2 
12.2 
12.8 
11.8 
11.6 

12.6 
1.? 



MEAN 
6.4 
8.* 
7.3 
0.2 
0.7 



S.O. 

5.2 

4.0 

3.9 

0.7 

2.0 



0.76 
0.59 
0.7' 
0.62 
0.42 
0.77 
0.69 
0.67 
0.85 
0.65 
0.78 
0.42 
0.57 
0.74 
0.6« 
0.77 
0.78 

0.6* 
0.1? 



0.74 
0.73 
0.75 
0.6* 
0.54 
0.60 
0.63 
0.44 
0.57 
0. 72 
0.84 
0.61 
0.71 
0.81 
0.75 
0.77 
0.73 

0.68 
0.10 



10.2 
12.0 
10.0 
11.8 

n.8 

10. 1 

11.1 

11.3 
8.9 
11.5 
9.9 
13.8 
12.3 
10.4 
11.0 
10.0 
10.0 

11.1 
1.3 



0.76 
3312 
438510 



0.80 
4594 
456?B« 



MF AN 

9.5 
11.2 

5.1 

0.2 

0.4 

25171 
363515? 



S.O. 
5.3 
4.1 
3.8 

0.7 
1.5 



2 



HSR tOR? 5FNIPPS 
WPfTfNG 



tlHlTt ,4AI> 



PLACK MALE 



R! AC.K FEMAIF 



HISPANIC MALF 



HISPANIC FEMAIF 



1 TFM 
ItF* 
ITEM 
I TFM 
ITFM 
1 TFM 
1T*M 
DFM 
ITFM 
I T7M 10 
I TFM tt 
ITFM U 

ur* 13 

ITfK t4 
ITFM 1* 
ITFM 16 
ITFM t7 



nr AM 



Pf 
0.74 
0.54 

o.n 
a.6i 
o.is 

0. 77 
0.6* 
0.6/ 
0.3* 

a. 62 

0.7ft 

0.5H 
0.75 
0.60 

0.77 
0. 76 

0.67 

o.n 



is 

0.7? 
J. 68 
0.74 
O.f 4 
0.5^ 
0.f>1 
0.61 
0.4? 
0.57 
•1. 70 
0.8? 
O.'-O 
0.7? 

o.po 

0.70 
0.75 
0.69 

0.67 

o. to 



OFLTA 

10.4 

12.4 

10. 6 

11.9 

14.1 

10. ! 

11.2 

11.2 

A. 7 
It. 7 

9.9 
14.0 
1 *».? 

10. ^ 

11. ? 
10.0 
10.0 

11,2 
1.4 



0.«f 
0.75 
0.09 
0.7? 
0.54 
0.84 
0. 7H 
0.74 
0.P9 
0. 77 
0.88 

0.67 
O.P« 
0.81 
0.R6 
0.87 

0.7« 
0. 1 1 



PHI S 
0.73 
0.7? 
0.75 
0.69 
0.57 
0.59 
0.61 
0.^5 
0.46 

o.n 

0.85 
U.M 

0.81 
0. 77 
0.76 
0.71 

0.67 

o.n 



OFl TA 
9.6 

10. t 
8.0 

10.6 

12.6 
9.1 
9.9 

10.4 
8.1 

10.0 
8.3 

n.o 
I f .? 

8.9 
*.6 
8.6 
8.6 

o.7 
1.4 



0.54 
0.33 
0.5O 

0.44 
0.31 
0.65 
0.5«i 
0.51 
0. 7? 
0.44 
0.59 
0.?9 
0.35 
0.51 
0.46 
0.59 
0.54 

0.49 
0.1? 



r IS 

0.63 
0.6? 
0.54 
0.60 
0.?6 
0.43 
0.54 
0.46 
0.5/ 
0.6? 
0.71 
0.*4 
0.49 
0.67 
0.60 
0.67 
0.61 

0.56 

0.10 



OFLTA 
12.6 
14. » 
l?.l 
13.6 

ts.n 

11.4 
12. r » 
1?.9 
10.7 
13.6 
1?.l 
t5.? 
14.5 
12.9 
13.4 
12. t 
1?.6 

13.1 
1.2 



P» 
0.70 
0.45 
0.76 
0.51 
0.33 
0.70 
0.60 
0.56 
0.81 
0.57 
0.70 
0.37 
0.3« 
0.64 
0.53 
0,65 
0.66 

0.58 
0.14 



PBIS 
0.66 
0.68 
0.68 
0.60 
0.37 
0.41 
0.57 
0.39 
0.56 
0.59 
3.73 
0.53 
0.55 
0.66 
0.68 
0.64 
0.60 

0.58 

o. to 



OFLTA 
tl.O 
13.5 
10.2 
12.9 
14.8 
10.9 
12.0 
1?.4 
9.6 
1?.? 
10.9 
14.3 
14.? 
11.6 
12.7 
11.5 
11.3 

l?.l 
t.4 



P* 
0.57 
0.39 
0.58 
0.4? 
0.?6 
0.6? 
0.5? 
0.55 
0.73 
0.41 
0.57 
0.27 
0.34 
0.5? 
0.46 
0.57 
0.58 

0.49 
0.12 



«8tS 
0.65 
0.63 
0.60 
0.59 
0.38 
0.53 
0.53 
0.44 
0.57 
0.63 
0.75 
0.«9 
0.56 
0.73 
0.65 
0.69 
0.63 

0.60 
0.09 



OF.LTA 


P* 


1?.3 


0.70 


14.1 


0.51 


12.2 


0.75 


13.8 


0.53 


15.6 


0.32 


11.7 


0.71 


12.8 


0.61 


12.4 


0.64 


10.6 


0.78 


13.9 


0^55 


12.3 


0.68 


15.4 


0.35 


14.6 


0.4? 


12.8 


0.64 


13.4 


0.60 


12.1 


0.69 


1?.? 


0.70 


13.1 


0.60 


1.3 


0.13 



R81S 
0.69 
0.63 
0.66 
0.55 
0.5? 
0.5' 
0.58 
0.47 
0.58 
0.6S 
0.77 
0.63 
0.61 
0.74 
0.66 
0.69 
0.63 

0.62 
0.08 



OFLTA 
tO. 9 
12.9 
10.4 
12.7 
14.9 
10.8 
11.9 
11.5 
9.9 
12.5 
lt.l 
14.6 
13.8 
116 
12.0 
11.1 
10.9 

12.0 
1.4 



W 



Smmmasy: 

I4FAN S.h. 

MPMUtA SC"*F °.3 

f KfllMT II. I '«.<} 

t W'H'Nfi 5.1 **. ? 

* i)M;rs o.? 0.7 

« Nor uFAC ieo 0.4 1.3 

cor f 1 icit^r \\ pha o.m? 

SAMPl.r Sl/P 9?0f 

pii^MiArmv f=sTiMAT^ izviun 



» IF A M 
IUO 

1 im 1 

3.6 
1 

0.^ 

.1. 78 
«43* 
1339370 



S.D. 
4. 2 
3.3 
3.0 
0.5 
V.O 



MP AM 
5.? 
7.7 
7.5 
0.4 
1.3 



S.n. 

4.6 
3.7 
3.6 
1.3 
>.5 



0.74 
t*4| 
206302 



MF AN 
7.2 
9.3 
6.4 
0.3 
1.0 



s.o. 

4.7 
^.8 
3.5 
0.8 
2.1 



0.74 
1771 
?3??*8 



MF AH 
5.4 
8.0 
8.0 
0.3 
0.7 



S.O. 

5.0 

3.9 

3.9 

0.8 

7.0 



0.78 
?312 
251292 



MF AN 
7.6 
9.7 
6.3 

0.2 
0.7 



S.O. 

5.1 

4.0 

3.8 

0.7 

1.9 



0.80 
2192 
205097 



ERLC 
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ITEM I 

ITEM 2 

ITFK 3 

I TEH 4 

I TEM 5 

I TEH 6 

urn 7 

ITE* « 
ITEM 9 
ITE* 10 

MEAN 
S.O. 

SUMMARY! 

FORMULA SCOPF 

• RIGHT 
i WKOVG 

# OMITS 

* NOT PEACMFP 



MALE 

»♦ PBIS DfclTA 

0.95 0.6? 6-* 

0.63 0.60 il.7 

0.4* 0.65 U.l 

0.7? 0.72 10.7 

0.71 0.71 10.7 

0.*9 0.6* 13.1 

0.5* 0.5? 12.6 

0.6* 0.61 11.5 

0.67 0.71 11.? 

0.46 0.50 13.4 

0.65 0.6* II.? 

0.13 O.Ofl l.ft 



HSF 19B2 SENIORS 
CIVICS EDUCATION 

FEMAIF 

*v RBIS OEITA 

0.97 0.63 5.6 

0.6* 0.60 11.1 

0.67 0.63 11.3 

0.72 0.67 10.7 

0.69 0.6* 11.0 

0.** 0.6* 13.6 

0.63 0.5* 11.6 

0.7? 0.69 10.7 

0.71 0.7? 10.7 

0.40 0.53 13.2 

0.67 0.6? 11.0 
O.U 0.05 2.0 



TOTAl 



?♦ RBIS DELTA 

0.96 0.66 6.1 

0.65 0.60 11.* 

0.67 0.6* 11.? 

0.72 0.69 10.7 

0.70 0.66 10.9 

0.*7 0.65 13*3 

0.59 0.53 12.1 

0.6R 0.60 11.1 

0.69 0.7? 11,0 

0.*7 0.52 13.3 

0.66 0.63 U.l 

0.13 0.06 1.9 



MFA*l 
5.3 
6.* 
3.* 
0.0 
0.2 



S.D. 

2.9 

?.2 

?.! 

0.3 

0.7 



MEAN 
5.6 
6.7 
3.2 
0.1 
0.1 



S.D. 

2.7 

2.1 

2.0 

0.3 

0.6 



MEAN 
5.* 
6.5 
3.3 
0.1 
0.1 



S.D. 

2.8 

2.1 

2.1 

0.^ 

0.6 



COEFFICIENT Al PHA 
SAMPLE SIZE 
PnPJlATIflN FSTI MATT 



0.62 
l?38? 
IF 0*660 



0.*A 
126"* 
1811677 



0.60 
25066 
3616337 
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WHITE 



HSU 1982 SENIORS 
CIVICS EDUCATION 

BLACK 



HISPANIC 



























P* 


PDIS 


DELTA 


P* 


RB1S 


DELTA 


P* 


Ml S 


ITF" 


1 


0.97 


0*63 


5.* 


0.91 


0.6* 


7,6 


0.92 


0.61 


I TEH 


? 




0*60 


11.1 


0.5* 


0.58 


12*2 


0.57 


0.60 


ITF* 


3 


o. n 


O.f * 


10.8 


0.57 


0.«f 


17.3 


0.*5 


0.63 


ZT r M 


* 


0.75 


0.69 


10.3 


0*6* 


0.61 


11.5 


0. 60 


0.68 


ITS* 




0.7* 


0*69 


10.* 


0*56 


0.56 


12.* 


0.59 


0.62 


ITEM 


/ 


0.51 


0.66 


i?.9 


0*3* 


0.5* 


14.6 


0.^1 


0.56 


ite* 


7 


0.61 


0.51 


11.4 


0*53 


0.51 


12.7 


0.51 


0.47 


item 


P 


0.71 


0.60 


10.7 


o.*r 


0*56 


12.2 


0.60 


0.57 


I Tf A 


9 


0.75 


0.7? 


10.* 


0.55 


0*61 


12.5 


0.5* 


0.63 


ITCH 


10 


0.«t<* 


0.52 


13.1 


0.*1 


0.51 


11.9 


0.19 


0.*? 


••CAN 


0.6« 


0.63 


10.7 


0.57 


0.57 


12.2 


0.56 


0.5* 


S.O. 


0.13 


0.06 


2.0 


0. u 


0*0* 


1.7 


0.15 


0.07 



5U."4ARY: 

*EAN s.n. 

FORMULA SCORf 5.9 z.j 

# RIGHT 6.9 2.1 

# w-ONG 3.0 2.0 

# OMITS o.O 0.3 
f NOT hLAChCII CM 0.5 

roF^ncir^T hpha 0.50 

SAT I E SIZF 16576 

POPULATION FSTMATE 7626725 



MEAN 
4.7 
5.6 
*.l 
0.1 
0.3 



S.O. 

7.7 

2.1 

2.1 

0.* 

0.9 



0.53 
3795 
* 36*76 



MEAN 
*.l 
5.5 
*.2 
C.I 
0.2 



7.3 
12.3 
12.5 
12.0 
12.1 
14.8 
12.9 
17.0 
12.6 
U.l 

12.2 
1.9 



S.O. 

2.8 

2.1 

2.1 

0.1 

0.8 



0.55 
**8* 
65083? 



P* 

0.96 
0.65 
0.67 
0.77 
0.70 
0.47 
0.59 
0.68 
0.6« 
0.*7 

0.66 
0.11 



TOTAL 

R8IS OELTA 



0.66 
0.60 
0.64 
0.69 
0.68 
0.65 
0.53 
0.60 
0.72 
0.52 

0.63 
0.06 



MF AN 
5.* 
6.5 
3.3 
0.1 
0.1 



6.1 
11.6 
11.2 
10.7 
10.9 
13.3 
12.1 
U.l 
11.0 
11.3 

U.l 
1.9 



S.O. 

2.8 

2.1 

7.1 

0.3 

0.6 



0.60 
75066 
3616337 



MSB 19ft? SENIORS 
CIVICS EDUCATION 



WHITE MUF 



WHITF FFMALF 



BLACK MALE 



RLACK FFMALF 



HISPANIC HALF 



HISPANIC FFMALF 



ITEM I 
I KM i 
ITfM 
ITM 
ITCH 
ITFM 
ITFM 
ITEM 
ITFM 



If?M 10 
MFAN 

s.n. 

SUMMARY: 

FORMULA SCORE 

* iUGHT 
$ WROMC 

* OMITS 

* NOT PEACHED 

CiJHFMClF 'T ALPHA 
SA.Wir Sl/F 
PUPtfLATION FSTIMATF 



P* 

0.97 
0.6* 
0. 71 
0.75 
0.75 
0.54 
0.57 
0.6/ 
0.73 
0.48 



RRIS 
0.65 
0.61 
0.66 
0.72 
0.7* 
0.70 
0.5? 
0.61 
0.7? 
0.51 



0.*3 O.np 



OFLTA 

5.6 
U.5 
10.7 
10.3 
10.2 
12.6 
l?.3 
II.? 
10.6 
13.? 

10. 8 

7.0 



*FAM 
5.7 

3.1 

0.0 
O.I 



n.o. 

7.3 

?.i 
?.i 

0.1 
0.6 



O.M 
81 J? 
1?<M606 



P* 
0.91 
0.71 
0.71 
0. 75 
0.74 
0.48 
0.66 
0.7S 
0.76 
0.50 

0. 70 
0.13 



RBIS 
0.60 
0.59 
0.6? 
0.67 
0.65 
0.64 
0.54 
0.58 
0.73 
0.54 

0.6? 
0.05 



DELTA 

5.1 
10.8 
10.8 
10.3 
10.5 
13.? 
11.4 
10.? 
10.1 
13.0 

10. * 
2.1 



"FAN 
6.« 
7.0 
?•* 
0.1 
0.1 

0.56 
P404 
13351 10 



S.I. 
Z.ti 
7.0 
1.9 
0.3 
O.S 



P* 
0.90 
0.58 
0.59 
0.64 
0.60 
0.37 
0.49 
0.54 
0.53 
0.4? 



RPIS 
0.63 
0.58 
0.56 
0.60 
0.61 
0.52 
0.51 
0. 56 
0.63 
0.50 



0.57 0.5ft 
0.14 0.06 



MMM 

5.5 
4. I 
0.1 
0.3 

0.55 
1538 
206010 





















DEL T A 


P* °A|S 


DELTA 


»♦ 


RftIS 


OELT A 


P* 


8815 


OFLTA 


7.9 


0.°2 0.66 


7.3 


0*40 


0.63 


7.9 


0.96 


0.55 


6.1 


lr« ; 


n Cfl n Co 

U. 9" 'J«3t 


1 Cm C 


0*54 


0.58 


1 2.6 


0.61 


0.61 


11.9 


l?.l 


0.55 0.54 


1?«5 


0.55 


0.63 


12.5 


0.55 


0.63 


12.5 


11.6 


0.65 0.53 


11.5 


0.60 


0.67 


12.0 


0*60 


0.69 


12.0 


1?.0 


0.54 0.5? 


12.6 


0.59 


0.64 


12.1 


0*59 


O.Al 


12.1 


14.4 


0.3? 0.56 


14.8 


0.35 


0.57 


14.6 


0.31 


0.56 


15.0 


13.1 


0.57 0.5? 


12.3 


0.46 


0.44 


13.4 


0.58 


0.50 


12.2 


12.6 


0.61 0.56 


11.9 


0.57 


0.55 


12.3 


0*63 


0*58 


11.* 


1?.7 


0.56 0.63 


12.4 


0.53 


0.6? 


12.7 


0*56 


0.63 


12.4 


13.8 


0.41 0.5? 


13.* 


0.37 


0. 39 


14.4 


0*42 


0.45 


13.0 


1?.? 


0.57 0.56 


12.2 


0*55 


0.57 


12.4 


0*58 


0.58 


12.0 


1.6 


0.15 0.05 


1.9 


0.14 


0.09 


1.7 


0*16 


0.07 


2.2 




MFAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.O. 




4.2 


2.7 


3. 


9 


2.8 


4. 


4 




2.2 


5.6 


2.0 


5. 


4 


2.1 


5. 


7 


2*1 


2.1 


4.1 


2.0 


4.4 


2.1 


4. 


1 


2*1 


0.4 


0.1 


0.3 


0. 


I 


0.3 


0. 


0 


0.3 


1.0 


0.2 


0.8 


0.2 


0.9 


0.2 


0*8 



0.50 
1757 
230466 



0.54 
230? 
249237 



0*55 
2182 
201595 



W 

H 

00 



21 



o r o 
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ITEM PARAMETERS FOR VOCABULARY TEST 



ITEM NUMBER 



ERIC 









"A" 




•C 11 




Ufa 

HS8 


t if* n 

HSB 


ITEM 


ITEM 


GUESSING 


1 AT) 

It fZ 


1 A OA 

19 BO 


1 A A ^ 

1982 


DISCRIMINATION 


DIFFICULTY 


PARAMETER 








- 


IB 1 II «• M ■■ « T¥ ■ .11 




i 


t 
1 


5 


t t AV A 

1. 1040 


-1*6775 


0.1088 






7 


1.6623 


-0*5267 


0.2047 






1 A 

10 


V ^ A A 

1*4060 


-0*0447 


0.2818 






11 


1*5896 


-0*6255 


0.3143 


i 


7 


13 


1 .7168 


0*2290 


0.2100 


A 

o 


a 
8 


15 


1* 1963 


1*1996 


0.1894 




12 


18 


1*4128 


1*0050 


0.1649 


13 


13 


1 A 

19 


1*7500 


1*8910 


0.2921 


1 c 
15 


15 


21 


* A % ft? A 

1*0159 


0*5724 


0.1243 


2 


2 




1*5207 


0*4122 


0.1489 


6 


6 




0*9061 


0*3904 


0.2105 


A 

9 


9 




1*0773 


0*7105 


0.2459 


t a 
10 


1 A 

10 




1*2463 


0*3345 


0.1581 


11 


11 




1*6054 


0*9721 


0.1705 


14 






0* 1800 


1*2566 


0.0214 






1 


1*3079 


-1*2191 


0.1088 






2 


1*4812 


-1*8990 


0.1088 






3 


1*3062 


-1*1016 


0.1088 






4 


1*0721 


-1*4115 


0.1088 






6 


1*2306 


-0*1428 


0.1815 






8 


I .3764 


-I •2464 


0.1088 






9 


1.7421 


-0*6824 


0.2127 






12 


0.6828 


-1.3722 


0.1088 






14 


1.6940 


0*5846 


0.1208 






16 


0.5327 


-0*4313 


0.1088 






17 


0.9890 


0*3373 


0.1349 






20 


1.7500 


1.4209 


0.1743 




16 




0.5852 


-2.3193 


0.1088 




17 




0.5680 


-0.4781 


0.1088 




18 




1.7500 


-0.3038 


0.0635 




19 




0.6829 


-0.2307 


0.1088 




20 




1.6096 


0.2853 


0.1539 




21 




1.2016 


2.5332 


0.2024 




22 




1.2794 


0.8636 


0.2601 




23 




0.9066 


-0.1212 


0.1067 




2* 




0.8137 


1.3922 


0.3167 




25 




0.5170 


1.0191 


0.0779 




26 




1.7500 


0.9889 


0.2430 




27 




1.7500 


1.0682 


0.2015 



> I- A 
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ITEM PARAMETERS FOR READING TEST 



ITEM NUMBER 



NLS 
1972 



HSB 
1980 



HSB 
1982 









— — — 


6 


6 


14 


7 


7 


IS 


8 


8 


16 


9 


9 


17 


10 


10 


10 


11 


11 


11 


12 


12 


12 


13 


13 


13 


1 


1 




2 


2 




3 


3 




4 


4 




5 


5 




14 


14 




IS 


15 




16 


16 




17 


17 




18 


18 




19 


19 




20 


20 





1 

2 
3 
5 
6 
7 
8 
9 
18 
19 
20 



"A" 

ITEM 
DISCRIMINATION 



1.1698 

0.8564 

1.4939 

0.9988 

1.2763 

0.8511 

0.7508 

1.3581 

0.8239 

1.4211 

0.5582 

0.7583 

0.7529 

0.6847 

1.2841 

0.9769 

0.5672 

1.0555 

1.4063 

1.5000 

0.9985 

0.8092 

0.9177 

1.0444 

1.0296 

1.1336 

1.5000 

1.2686 

1.5000 

1.5000 

0.9933 



ITEM 
DIFFICULTY 



-0.6847 
0.2549 
0.1951 
0.6861 
0.3707 
0.8157 
-1.4490 
-0.0434 
-1.2432 
0.0727 
-2.3112 
-0.5175 
-0.6394 
1.1942 
1.5813 
0*3640 
1.3461 
-0.1353 
1.1597 
0.7802 
-2 .4400 
-1.7381 
-1.1389 
-0.5677 
-0.2096 
0.4778 
0.2363 
1.6799 
0.4383 
1.6607 
0.1632 



GUESSING 
PARAMETER 



0.1048 

0.0469 

0.1877 

0.1962 

0.2667 

0.1709 

0.1048 

0.1170 

0.1048 

0.2751 

0.1048 

0.1048 

0.1048 

0.0616 

0.1045 

0.1126 

0.1643 

0.2842 

0.2805 

0.2261 

0.1048 

0.1048 

0.1048 

0.1048 

0.1642 

0.2362 

0.1607 

0.1104 

0.1391 

0.1766 

0.1936 



255 
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F3 



ITEH PARAMETERS FUR MATHEMATICS TEST 



ITEM NUMBER 

ha* "B" "C" 



NLS HSB HSB ITEM ITEM GUESSING 

1972 1980 1982 DISCRIMINATION DIFFICULTY PARAMETER 



. 2 


2 


2 


0.3468 


-2. 1432 


0.1640 


3 


3 


3 


0.6282 


-1.0846 


0.1640 




4 


4 


0.5806 


-1.1984 


0.1640 


5 


5 


5 


1.7031 


-0.4617 


0.1134 


10 


10 


10 


1.3073 


-0.0352 


0.1688 


12 


12 


12 


1.0576 


-0.4201 


0.1709 


13 


13 


13 


1. 1327 , 


-0.2033 


0.0512 


16 


16 


16 


1.5999 


0.1096 


0.1173 


17 


17 


17 


1.1741 


0.2752 


0.2328 


20 


20 


20 


1.2187 


-0.0838 


0 • 0997 


21 


21 


21 


1.3358 


0.3765 


0.0587 


24 


24 


24 


0.7733 


0.6403 


0.0528 




6 


6 


0.5848 


-0.9134 


0.1640 




ii 


11 


0.8459 


0.6796 


0.2111 




14 


14 


0.7677 


-0.3168 


0.1640 




15 


15 


1.1100 


0.7337 


0.4049 




18 


18 


0.6471 


0.6145 


0.1065 




22 


22 


1.3993 


0.3151 


0.1402 


1 






0.6767 


-1.3617 


0.1640 


6 






0.8281 


-0.7268 


0.1640 


7 






1.0117 


-0.6724 


0.1640 


8 






0.9284 


0.1355 


0.1747 


9 






0.6567 


-0.7121 


0.1640 


11 






0.7237 


-0-0768 


0.0949 


14 






0.6446 


-0.3706 


0.1640 


15 






1.1395 


0.6473 


0.3441 


18 






0.6967 


0.2685 


0.1214 


19 






1.0594 


0.8592 


0.3758 


22 






0.8805 


0.3845 


0.1169 


23 






1.7043 


0.8720 


0.2010 


25 






2.0000 


0.8608 


0.2661 




1 




0.7198 


-3.3442 


0.1640 




7 




1.2469 


-0.6133 


0.1571 




8 




0.3930 


-3.9020 


0.1640 




9 




0.9105 


-0.1229 


0.2967 




19 




1.0517 


0.2407 


0.3099 




23 




0.2700 


0.9508 


0.1640 




25 




2.0000 


1.4548 


0.3259 




26 




1.4623 


0.3848 


0.2184 




27 




2.0000 


0.6837 


0.1961 








I CONTINUED) 
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ITEM PARAMETERS FOR MATHEMATICS TEST (CONTINUED) 



ITEM NUMBER 



NLS 
1972 



HSB 
1980 



HSB 
19B2 



"A" 
ITEM 
DISCRIMINATION 



•«B" 
ITEM 
DIFFICULTY 



GUESSING 
PARAMETER 



28 
29 
30 
31 

32 



1 
7 
8 
9 
19 
23 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 



1 76. ^ A 


~0 •4650 


0.2081 




-2 •3041 


0. 1640 


U • OJUJ 


<£• 1930 


0.1376 


2 . noon 


Urn 9Z89 


0.3011 


7 onnn 


1 iQi o 

1 • 3V12 


0.4290 


n 77on 


-1 .9465 


0.1640 


1 - 7«>01 

J. • 1 A 


"*0« 3 13 3 


0. 1654 


2.0000 


—A Q1QQ 




0.5370 


'0.6883 


0.1640 


1.4231 


-0,1776 


0.1414 


1.6972 


1.5934 


0.1875 


0.9614 


0.0693 


0.1123 


1.5044 


0.8435 


0.0484 


1.2008 


0.7088 


0.1610 


1.7647 


1.6179 


0.0833 


2.0000 


1.5011 


0.4089 


1.3567 


-0.4214 


J. 1003 


1.1021 


0.4283 


- "*533 


0.4298 


-1.6453 


' j40 


1.6024 


-0.1748 


0.0416 


1.3552 


1.1861 


0.1059 


0.9829 


J .2870 


0.1397 


1.9607 


U.3445 


0.2466 


1.7430 


1.7907 


0.1859 


1.0464 


1.5440 


0.2528 



9 

ERIC 
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F4 

ITEM PARAMETERS FOR SCIENCE TEST 



ITEM ITEM GUESSING 

ITEM NUMBER OISCkIMINATION OIFFf CULTY PARAMETER 



I 


0.9547 


-1.6738 


0.1134 


2 


0.4115 


•1.8636 


0.W34 


3 


0 9601 


-0.8709 


0.1134 


4 


1.1322 


-0.2356 


0.3508 


5 


1.4000 


-0.9345 


0.0737 


6 


0.6145 


-2.1830 


0.1134 


7 


0.8645 


0.1498 


0.2147 


8 


1.2429 


-0.8536 


0.1134 


9 


1.4000 


-0.3937 


0.1296 


10 


0.3285 


-1.3860 


0.1134 


11 


1.2810 


0.0946 


0.2501 


12 


1.4000 


0.2166 


0.1744 


13 


1.3035 


-0.0999 


0.1616 


14 


0.9908 


1.6274 


0.1324 


15 


1.4000 


1.1208 


0.3186 


16 


0.5270 


0.9946 


0.1116 


17 


0.9964 


0.1338 


0.0722 


18 


0.7907 


1.4249 


0.1979 


19 


1.40O0 


1.2436 


0.1780 


20 


1.4000 


4.9122 


0.2112 



-211- 



F5 



ITEM PARAMETERS FOR WRITING TEST 



"A" "B M "C" 

ITEM ITEM GUESSING 

ITEM NUMBER DISCRIMINATION DIFFICULTY PARAMETER 



1 


0.96 78 


2 


1.1138 


3 


1.1213 


4 


1.4461 


5 


1.3744 


6 


0.5903 


7 


0.9751 


8 


0.2351 


9 


0.4867 


10 


1,0349 


11 


1.4248 


12 


0.7331 


13 


1.5000 


14 


1,2371 


15 


1.2441 


16 


1.0856 


17 


0.9234 



-0.9819 


0.1196 


-0.1070 


0.1303 


-0.9913 


0.1196 


0.1123 


0.2851 


1.0233 


0.2318 


-1.4046 


0.1196 


-0.1766 


0.3348 


-1.2373 


0.1196 


-2.2913 


0.1196 


-0.2917 


0.1441 


-0.9238 


0.1196 


0.7714 


0.1097 


0.1792 


0.1899 


-0.8386 


0.1196 


-0.3693 


0.1911 


-0.8846 


0.1196 


-0.9609 


0.1196 
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